2024-09-17T22:51:54.694 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T22:51:54.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T22:51:54.798 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/journal} email: ceph-qa@ceph.com first_in_suite: false job_id: '7909565' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd memory target: 1610612736 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1983 sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f sleep_before_teardown: 0 subset: 79/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7nS0AcqtttGJsv73Qr/WrNX2I0l1wxwVEZaLTc1zTG7MYVFth5iia3NRdE8vR0luuiAcIHOVIKZivAJo2gWns= smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBH3YuhgHeaR9fCOJnytSc76s3fqiEqFJyaURKg9KTAMWKfjS+aGLztVJa/lhcBqAkitg7rboKLGnlKir2sxiUc= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - workunit: clients: client.0: - rbd/journal.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_21:16:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T22:51:54.798 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa; will attempt to use it 2024-09-17T22:51:54.799 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa/tasks 2024-09-17T22:51:54.799 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T22:51:54.800 INFO:teuthology.task.internal:Checking packages... 2024-09-17T22:51:54.825 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c2ddf9721ef254645201cdbabd9c8f49c30a586f' 2024-09-17T22:51:54.825 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T22:51:54.825 INFO:teuthology.packaging:ref: None 2024-09-17T22:51:54.825 INFO:teuthology.packaging:tag: None 2024-09-17T22:51:54.825 INFO:teuthology.packaging:branch: squid 2024-09-17T22:51:54.825 INFO:teuthology.packaging:sha1: c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T22:51:54.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-17T22:51:55.030 INFO:teuthology.task.internal:Found packages for ceph version 19.2.0-0 2024-09-17T22:51:55.032 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T22:51:55.039 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T22:51:55.039 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T22:51:55.049 INFO:teuthology.task.internal:Saving configuration 2024-09-17T22:51:55.061 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T22:51:55.069 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T22:51:55.091 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 22:46:53.281500', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7nS0AcqtttGJsv73Qr/WrNX2I0l1wxwVEZaLTc1zTG7MYVFth5iia3NRdE8vR0luuiAcIHOVIKZivAJo2gWns='} 2024-09-17T22:51:55.112 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 22:46:53.279976', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBH3YuhgHeaR9fCOJnytSc76s3fqiEqFJyaURKg9KTAMWKfjS+aGLztVJa/lhcBqAkitg7rboKLGnlKir2sxiUc='} 2024-09-17T22:51:55.112 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T22:51:55.119 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-17T22:51:55.119 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-17T22:51:55.119 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T22:51:55.172 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f28c4e9bac0>, signals=[15]) 2024-09-17T22:51:55.172 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T22:51:55.178 INFO:teuthology.task.internal:Opening connections... 2024-09-17T22:51:55.178 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T22:51:55.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:51:55.257 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T22:51:55.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:51:55.329 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T22:51:55.334 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-09-17T22:51:55.352 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-09-17T22:51:55.353 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-09-17T22:51:55.409 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="9" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="9" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el9" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:LOGO="fedora-logo-icon" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T22:51:55.410 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T22:51:55.411 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-09-17T22:51:55.440 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-09-17T22:51:55.459 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-09-17T22:51:55.459 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-09-17T22:51:55.517 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T22:51:55.518 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-09-17T22:51:55.518 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T22:51:55.518 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T22:51:55.518 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T22:51:55.518 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-09-17T22:51:55.540 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T22:51:55.550 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T22:51:55.559 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T22:51:55.560 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-09-17T22:51:55.562 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-09-17T22:51:55.579 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T22:51:55.587 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T22:51:55.587 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-09-17T22:51:55.619 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-09-17T22:51:55.648 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T22:51:55.702 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T22:51:55.718 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T22:51:55.718 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T22:51:55.718 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T22:51:55.719 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T22:51:55.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T22:51:55.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T22:51:55.736 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-17T22:51:55.737 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-17T22:51:55.793 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-503.el9.x86_64 2024-09-17T22:51:55.793 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.14.0-503.el9.x86_64 2024-09-17T22:51:55.794 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-09-17T22:51:55.795 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-503.el9.x86_64 2024-09-17T22:51:55.795 INFO:teuthology.task.kernel:Running kernel on smithi005: 5.14.0-503.el9.x86_64 2024-09-17T22:51:55.795 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-09-17T22:51:58.335 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-17T22:51:58.798 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.3 MB 00:01 2024-09-17T22:52:02.216 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-09-17T22:52:02.852 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 5.9 MB/s | 20 MB 00:03 2024-09-17T22:52:06.591 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-17T22:52:08.167 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-17T22:52:09.553 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-17T22:52:10.188 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 12 MB/s | 23 MB 00:01 2024-09-17T22:52:10.994 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-17T22:52:12.816 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 13 MB/s | 23 MB 00:01 2024-09-17T22:52:15.735 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-17T22:52:17.700 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T22:52:17.700 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T22:52:17.800 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T22:52:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:52:17.812 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-17T22:52:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:52:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T22:52:17.812 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T22:52:17.812 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T22:52:17.812 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T22:52:17.813 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T22:52:17.813 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T22:52:17.813 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:52:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T22:52:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:52:17.813 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages 2024-09-17T22:52:17.813 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:52:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 79 M 2024-09-17T22:52:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 126 M 2024-09-17T22:52:17.814 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T22:52:18.036 INFO:teuthology.orchestra.run.smithi005.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 288 kB/s | 36 kB 00:00 2024-09-17T22:52:18.263 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T22:52:18.737 INFO:teuthology.orchestra.run.smithi005.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-17T22:52:19.195 INFO:teuthology.orchestra.run.smithi005.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-17T22:52:19.562 INFO:teuthology.orchestra.run.smithi005.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-09-17T22:52:19.562 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T22:52:19.563 INFO:teuthology.orchestra.run.smithi005.stdout:Total 45 MB/s | 79 MB 00:01 2024-09-17T22:52:20.178 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T22:52:20.178 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T22:52:20.271 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T22:52:20.278 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T22:52:20.283 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:52:20.283 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-09-17T22:52:20.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:52:20.285 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 79 M 2024-09-17T22:52:20.285 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 126 M 2024-09-17T22:52:20.285 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T22:52:20.506 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 310 kB/s | 36 kB 00:00 2024-09-17T22:52:20.651 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T22:52:20.651 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T22:52:21.637 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T22:52:21.637 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T22:52:23.881 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 4.5 MB/s | 16 MB 00:03 2024-09-17T22:52:24.208 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T22:52:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T22:52:24.962 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T22:52:25.815 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.4 MB/s | 29 MB 00:05 2024-09-17T22:52:27.721 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T22:52:27.840 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T22:52:28.023 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.5 MB/s | 35 MB 00:07 2024-09-17T22:52:28.023 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T22:52:28.023 INFO:teuthology.orchestra.run.smithi152.stdout:Total 10 MB/s | 79 MB 00:07 2024-09-17T22:52:28.710 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T22:52:29.057 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T22:52:29.058 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T22:52:30.039 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T22:52:30.039 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T22:52:32.476 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T22:52:32.962 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T22:52:33.008 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:52:33.135 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T22:52:33.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T22:52:35.998 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T22:52:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T22:52:38.148 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:52:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T22:52:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:52:46.010 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:17.421 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:17.462 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:17.753 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:17.753 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T22:53:17.753 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T22:53:17.753 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T22:53:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:18.567 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:53:18.567 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T22:53:18.568 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T22:53:18.568 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T22:53:18.568 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T22:53:18.568 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T22:53:18.568 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:53:18.568 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T22:53:18.878 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T22:53:18.967 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T22:53:18.967 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T22:53:18.967 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T22:53:18.968 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T22:53:18.968 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T22:53:18.968 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T22:53:18.968 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T22:53:18.968 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T22:53:19.027 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T22:53:19.027 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T22:53:19.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-09-17T22:53:19.063 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-09-17T22:53:19.064 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-09-17T22:53:19.064 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.06 2024-09-17T22:53:19.064 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 82.el9 2024-09-17T22:53:19.064 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-09-17T22:53:19.064 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T22:53:19.064 INFO:teuthology.orchestra.run.smithi005.stdout:Group : Unspecified 2024-09-17T22:53:19.064 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 8274670 2024-09-17T22:53:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-09-17T22:53:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T22:53:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T22:53:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T22:53:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T22:53:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : builder@centos.org 2024-09-17T22:53:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-09-17T22:53:19.065 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T22:53:19.066 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-09-17T22:53:19.066 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-09-17T22:53:19.066 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:53:19.066 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T22:53:19.066 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T22:53:19.066 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T22:53:19.066 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-09-17T22:53:19.066 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:53:19.067 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T22:53:19.068 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T22:53:19.068 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 5.14.0-508.el9.x86_64 2024-09-17T22:53:19.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T22:53:19.676 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-09-17T22:53:21.021 INFO:teuthology.orchestra.run.smithi005.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T22:53:21.052 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-09-17T22:53:21.063 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-17T22:53:21.079 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.sO46WZEehw 2024-09-17T22:53:21.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.sO46WZEehw 2024-09-17T22:53:21.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.sO46WZEehw 2024-09-17T22:53:21.289 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.sO46WZEehw is 6KB 2024-09-17T22:53:21.338 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.sO46WZEehw 2024-09-17T22:53:21.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T22:53:21.415 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T22:53:21.415 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T22:53:21.415 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T22:53:21.416 INFO:teuthology.orchestra.run.smithi005.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T22:53:21.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T22:53:21.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-09-17T22:53:24.545 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:24.584 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:24.933 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:24.934 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T22:53:24.934 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T22:53:24.934 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:53:25.801 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T22:53:26.192 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T22:53:26.282 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T22:53:26.282 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T22:53:26.282 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T22:53:26.282 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T22:53:26.282 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T22:53:26.282 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-17T22:53:26.282 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T22:53:26.283 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T22:53:26.342 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T22:53:26.342 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T22:53:26.342 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-09-17T22:53:26.381 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-09-17T22:53:26.381 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 82.el9 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8274670 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-09-17T22:53:26.382 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:53:26.383 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T22:53:26.384 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T22:53:26.384 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 5.14.0-508.el9.x86_64 2024-09-17T22:53:26.385 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T22:53:27.064 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-09-17T22:53:28.380 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T22:53:28.413 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-09-17T22:53:28.415 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-09-17T22:53:28.431 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.B8JOAKX574 2024-09-17T22:53:28.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.B8JOAKX574 2024-09-17T22:53:28.498 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.B8JOAKX574 2024-09-17T22:53:28.639 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.B8JOAKX574 is 6KB 2024-09-17T22:53:28.687 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.B8JOAKX574 2024-09-17T22:53:28.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T22:53:28.765 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T22:53:28.765 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T22:53:28.765 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T22:53:28.766 INFO:teuthology.orchestra.run.smithi152.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T22:53:28.767 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T22:53:28.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-09-17T22:53:51.575 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T22:53:51.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-17T22:53:51.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:53:58.933 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-17T22:53:58.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-17T22:53:58.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:54:33.537 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-17T22:54:42.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-17T22:54:42.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:54:51.585 DEBUG:teuthology.orchestra.remote:timed out 2024-09-17T22:55:00.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-17T22:55:00.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:55:00.925 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-09-17T22:55:01.169 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-17T22:55:01.588 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-17T22:55:01.589 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T22:55:01.589 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-09-17T22:55:01.604 INFO:teuthology.orchestra.run.smithi005.stdout:5.14.0-508.el9.x86_64 2024-09-17T22:55:01.604 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T22:55:01.604 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T22:55:01.604 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T22:55:02.605 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T22:55:02.605 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T22:55:02.694 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-09-17T22:55:02.717 DEBUG:teuthology.parallel:result is None 2024-09-17T22:55:12.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-17T22:55:12.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:55:13.210 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-17T22:55:13.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-17T22:55:13.705 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T22:55:13.705 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-09-17T22:55:13.731 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-508.el9.x86_64 2024-09-17T22:55:13.732 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T22:55:13.732 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T22:55:13.732 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T22:55:14.733 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-17T22:55:14.733 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T22:55:15.006 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2024-09-17T22:55:15.030 DEBUG:teuthology.parallel:result is None 2024-09-17T22:55:15.030 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T22:55:15.040 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T22:55:15.040 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T22:55:15.043 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T22:55:15.062 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T22:55:15.068 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T22:55:15.077 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T22:55:15.077 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T22:55:15.105 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T22:55:15.137 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T22:55:15.145 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T22:55:15.146 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T22:55:15.171 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T22:55:15.201 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T22:55:15.213 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T22:55:15.216 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T22:55:15.226 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T22:55:15.228 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T22:55:15.236 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T22:55:15.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T22:55:15.258 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T22:55:15.284 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T22:55:15.293 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T22:55:15.294 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T22:55:15.327 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T22:55:15.342 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T22:55:15.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T22:55:15.477 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T22:55:15.587 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T22:55:15.613 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T22:55:15.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T22:55:15.680 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T22:55:15.725 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T22:55:15.765 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T22:55:15.846 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T22:55:15.888 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T22:55:15.888 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T22:55:15.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-09-17T22:55:15.958 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-09-17T22:55:16.011 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T22:55:16.036 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T22:55:16.393 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T22:55:16.401 INFO:teuthology.task.internal:Starting timer... 2024-09-17T22:55:16.401 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T22:55:16.414 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T22:55:16.424 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-17T22:55:16.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-09-17T22:55:16.484 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-09-17T22:55:16.486 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-09-17T22:55:16.534 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-09-17T22:55:16.536 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T22:55:16.536 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-09-17T22:55:16.555 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-09-17T22:55:16.555 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-09-17T22:55:16.579 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-09-17T22:55:16.580 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi152.front.sepia.ceph.com': 'permissive'} 2024-09-17T22:55:16.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T22:55:16.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T22:55:16.622 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T22:55:16.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T22:55:16.648 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T22:55:16.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-09-17T22:55:16.697 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-09-17T22:55:16.741 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T22:55:16.754 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T22:55:16.765 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T22:55:16.766 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T22:59:02.669 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2024-09-17T22:59:02.671 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-17T22:59:02.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:59:02.750 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-09-17T22:59:02.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-09-17T22:59:02.834 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-17T22:59:02.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T22:59:02.908 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-09-17T22:59:02.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-09-17T22:59:02.980 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T22:59:02.991 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T22:59:02.991 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T22:59:02.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T22:59:02.994 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T22:59:02.994 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T22:59:03.026 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T22:59:03.042 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T22:59:03.050 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T22:59:03.064 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T22:59:03.069 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-09-17T22:59:03.081 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-09-17T22:59:03.088 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-09-17T22:59:03.097 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T22:59:03.099 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-09-17T22:59:03.112 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T22:59:03.114 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T22:59:03.128 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T22:59:03.173 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-17T22:59:03.177 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T22:59:03.178 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-17T22:59:03.178 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T22:59:03.178 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T22:59:03.178 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T22:59:03.178 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T22:59:03.185 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-17T22:59:03.189 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T22:59:03.189 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-17T22:59:03.189 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T22:59:03.189 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T22:59:03.189 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T22:59:03.189 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T22:59:03.190 INFO:teuthology.run_tasks:Running task install... 2024-09-17T22:59:03.198 DEBUG:teuthology.task.install:project ceph 2024-09-17T22:59:03.198 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}} 2024-09-17T22:59:03.198 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'} 2024-09-17T22:59:03.198 INFO:teuthology.task.install:Using flavor: default 2024-09-17T22:59:03.204 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T22:59:03.204 INFO:teuthology.task.install:extra packages: [] 2024-09-17T22:59:03.204 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-17T22:59:03.205 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T22:59:03.207 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'tag': None, 'wait_for_package': False} 2024-09-17T22:59:03.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T22:59:03.356 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/ 2024-09-17T22:59:03.357 INFO:teuthology.task.install.rpm:Package version is 19.1.1-330.gc2ddf972 2024-09-17T22:59:03.360 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/ 2024-09-17T22:59:03.360 INFO:teuthology.task.install.rpm:Package version is 19.1.1-330.gc2ddf972 2024-09-17T22:59:03.468 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T22:59:03.468 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T22:59:03.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T22:59:03.474 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/c2ddf9721ef254645201cdbabd9c8f49c30a586f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T22:59:03.475 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T22:59:03.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T22:59:03.495 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T22:59:03.496 DEBUG:teuthology.orchestra.run.smithi005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2ddf9721ef254645201cdbabd9c8f49c30a586f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T22:59:03.501 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-17T22:59:03.501 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c2ddf9721ef254645201cdbabd9c8f49c30a586f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T22:59:03.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T22:59:03.567 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T22:59:03.639 DEBUG:teuthology.orchestra.run.smithi005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T22:59:03.642 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T22:59:03.704 INFO:teuthology.orchestra.run.smithi005.stdout:check_obsoletes = 1 2024-09-17T22:59:03.706 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum clean all 2024-09-17T22:59:03.707 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-09-17T22:59:03.708 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-09-17T22:59:03.945 INFO:teuthology.orchestra.run.smithi152.stdout:45 files removed 2024-09-17T22:59:03.945 INFO:teuthology.orchestra.run.smithi005.stdout:45 files removed 2024-09-17T22:59:03.972 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw 2024-09-17T22:59:03.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-radosgw 2024-09-17T22:59:04.548 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 290 kB/s | 84 kB 00:00 2024-09-17T22:59:04.590 INFO:teuthology.orchestra.run.smithi005.stdout:ceph packages for x86_64 263 kB/s | 84 kB 00:00 2024-09-17T22:59:04.832 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-17T22:59:04.874 INFO:teuthology.orchestra.run.smithi005.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-17T22:59:05.107 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-17T22:59:05.150 INFO:teuthology.orchestra.run.smithi005.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-17T22:59:06.924 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-17T22:59:07.133 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-17T22:59:08.759 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-17T22:59:09.009 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-17T22:59:13.168 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-17T22:59:15.194 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.5 MB 00:02 2024-09-17T22:59:15.660 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-17T22:59:16.786 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-17T22:59:17.997 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 10 MB/s | 23 MB 00:02 2024-09-17T22:59:18.340 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-17T22:59:23.411 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-17T22:59:24.037 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T22:59:25.620 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T22:59:25.632 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:59:25.632 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T22:59:25.632 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 11 M 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.4 M 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.2 M 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.4 M 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 21 M 2024-09-17T22:59:25.633 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 25 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 751 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 506 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.3 M 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T22:59:25.634 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 45 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 136 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 162 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 320 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 300 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 99 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-09-17T22:59:25.635 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T22:59:25.636 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:25.636 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T22:59:25.636 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:59:25.636 INFO:teuthology.orchestra.run.smithi152.stdout:Install 30 Packages 2024-09-17T22:59:25.636 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2024-09-17T22:59:25.636 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:25.636 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 60 M 2024-09-17T22:59:25.636 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T22:59:26.304 INFO:teuthology.orchestra.run.smithi152.stdout:(1/32): ceph-base-19.1.1-330.gc2ddf972.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-09-17T22:59:26.334 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T22:59:26.357 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:59:26.357 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 11 M 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: librados2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.4 M 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.2 M 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.4 M 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 21 M 2024-09-17T22:59:26.358 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 25 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 751 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 506 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2 x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 5.3 M 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T22:59:26.359 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 45 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 136 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 162 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 320 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 300 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 99 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T22:59:26.360 INFO:teuthology.orchestra.run.smithi005.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T22:59:26.361 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-09-17T22:59:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T22:59:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:26.361 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T22:59:26.361 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:59:26.361 INFO:teuthology.orchestra.run.smithi005.stdout:Install 30 Packages 2024-09-17T22:59:26.361 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 2 Packages 2024-09-17T22:59:26.361 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:26.362 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 60 M 2024-09-17T22:59:26.362 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T22:59:26.362 INFO:teuthology.orchestra.run.smithi152.stdout:(2/32): ceph-selinux-19.1.1-330.gc2ddf972.el9.x 433 kB/s | 25 kB 00:00 2024-09-17T22:59:26.530 INFO:teuthology.orchestra.run.smithi152.stdout:(3/32): ceph-radosgw-19.1.1-330.gc2ddf972.el9.x 14 MB/s | 11 MB 00:00 2024-09-17T22:59:26.571 INFO:teuthology.orchestra.run.smithi152.stdout:(4/32): libcephfs2-19.1.1-330.gc2ddf972.el9.x86 3.5 MB/s | 751 kB 00:00 2024-09-17T22:59:26.605 INFO:teuthology.orchestra.run.smithi152.stdout:(5/32): libradosstriper1-19.1.1-330.gc2ddf972.e 6.6 MB/s | 506 kB 00:00 2024-09-17T22:59:26.655 INFO:teuthology.orchestra.run.smithi152.stdout:(6/32): python3-ceph-argparse-19.1.1-330.gc2ddf 906 kB/s | 45 kB 00:00 2024-09-17T22:59:26.739 INFO:teuthology.orchestra.run.smithi152.stdout:(7/32): python3-ceph-common-19.1.1-330.gc2ddf97 1.6 MB/s | 136 kB 00:00 2024-09-17T22:59:26.855 INFO:teuthology.orchestra.run.smithi152.stdout:(8/32): librgw2-19.1.1-330.gc2ddf972.el9.x86_64 19 MB/s | 5.3 MB 00:00 2024-09-17T22:59:26.881 INFO:teuthology.orchestra.run.smithi152.stdout:(9/32): python3-cephfs-19.1.1-330.gc2ddf972.el9 1.1 MB/s | 162 kB 00:00 2024-09-17T22:59:26.906 INFO:teuthology.orchestra.run.smithi152.stdout:(10/32): python3-rados-19.1.1-330.gc2ddf972.el9 6.2 MB/s | 320 kB 00:00 2024-09-17T22:59:26.939 INFO:teuthology.orchestra.run.smithi152.stdout:(11/32): python3-rbd-19.1.1-330.gc2ddf972.el9.x 5.0 MB/s | 300 kB 00:00 2024-09-17T22:59:26.965 INFO:teuthology.orchestra.run.smithi152.stdout:(12/32): python3-rgw-19.1.1-330.gc2ddf972.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-17T22:59:27.182 INFO:teuthology.orchestra.run.smithi152.stdout:(13/32): ceph-common-19.1.1-330.gc2ddf972.el9.x 15 MB/s | 21 MB 00:01 2024-09-17T22:59:27.332 INFO:teuthology.orchestra.run.smithi152.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 272 kB/s | 107 kB 00:00 2024-09-17T22:59:27.357 INFO:teuthology.orchestra.run.smithi152.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 259 kB/s | 45 kB 00:00 2024-09-17T22:59:27.372 INFO:teuthology.orchestra.run.smithi005.stdout:(1/32): ceph-base-19.1.1-330.gc2ddf972.el9.x86_ 6.0 MB/s | 5.4 MB 00:00 2024-09-17T22:59:27.374 INFO:teuthology.orchestra.run.smithi152.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 392 kB/s | 160 kB 00:00 2024-09-17T22:59:27.414 INFO:teuthology.orchestra.run.smithi005.stdout:(2/32): ceph-selinux-19.1.1-330.gc2ddf972.el9.x 604 kB/s | 25 kB 00:00 2024-09-17T22:59:27.424 INFO:teuthology.orchestra.run.smithi152.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 847 kB/s | 42 kB 00:00 2024-09-17T22:59:27.491 INFO:teuthology.orchestra.run.smithi152.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-17T22:59:27.497 INFO:teuthology.orchestra.run.smithi005.stdout:(3/32): libcephfs2-19.1.1-330.gc2ddf972.el9.x86 8.8 MB/s | 751 kB 00:00 2024-09-17T22:59:27.516 INFO:teuthology.orchestra.run.smithi152.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-17T22:59:27.542 INFO:teuthology.orchestra.run.smithi152.stdout:(20/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-17T22:59:27.567 INFO:teuthology.orchestra.run.smithi152.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-09-17T22:59:27.572 INFO:teuthology.orchestra.run.smithi005.stdout:(4/32): libradosstriper1-19.1.1-330.gc2ddf972.e 6.6 MB/s | 506 kB 00:00 2024-09-17T22:59:27.592 INFO:teuthology.orchestra.run.smithi152.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-17T22:59:27.651 INFO:teuthology.orchestra.run.smithi152.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-17T22:59:27.676 INFO:teuthology.orchestra.run.smithi152.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 376 kB/s | 26 kB 00:00 2024-09-17T22:59:27.689 INFO:teuthology.orchestra.run.smithi005.stdout:(5/32): ceph-radosgw-19.1.1-330.gc2ddf972.el9.x 8.7 MB/s | 11 MB 00:01 2024-09-17T22:59:27.701 INFO:teuthology.orchestra.run.smithi152.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-09-17T22:59:27.723 INFO:teuthology.orchestra.run.smithi005.stdout:(6/32): python3-ceph-argparse-19.1.1-330.gc2ddf 1.3 MB/s | 45 kB 00:00 2024-09-17T22:59:27.726 INFO:teuthology.orchestra.run.smithi152.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-17T22:59:27.773 INFO:teuthology.orchestra.run.smithi005.stdout:(7/32): python3-ceph-common-19.1.1-330.gc2ddf97 2.7 MB/s | 136 kB 00:00 2024-09-17T22:59:27.785 INFO:teuthology.orchestra.run.smithi152.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-17T22:59:27.827 INFO:teuthology.orchestra.run.smithi152.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-09-17T22:59:27.832 INFO:teuthology.orchestra.run.smithi005.stdout:(8/32): python3-cephfs-19.1.1-330.gc2ddf972.el9 2.7 MB/s | 162 kB 00:00 2024-09-17T22:59:27.900 INFO:teuthology.orchestra.run.smithi005.stdout:(9/32): python3-rados-19.1.1-330.gc2ddf972.el9. 4.7 MB/s | 320 kB 00:00 2024-09-17T22:59:28.007 INFO:teuthology.orchestra.run.smithi005.stdout:(10/32): librgw2-19.1.1-330.gc2ddf972.el9.x86_6 12 MB/s | 5.3 MB 00:00 2024-09-17T22:59:28.033 INFO:teuthology.orchestra.run.smithi005.stdout:(11/32): python3-rbd-19.1.1-330.gc2ddf972.el9.x 2.2 MB/s | 300 kB 00:00 2024-09-17T22:59:28.044 INFO:teuthology.orchestra.run.smithi152.stdout:(29/32): librados2-19.1.1-330.gc2ddf972.el9.x86 16 MB/s | 3.4 MB 00:00 2024-09-17T22:59:28.060 INFO:teuthology.orchestra.run.smithi005.stdout:(12/32): python3-rgw-19.1.1-330.gc2ddf972.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-17T22:59:28.086 INFO:teuthology.orchestra.run.smithi152.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-09-17T22:59:28.211 INFO:teuthology.orchestra.run.smithi152.stdout:(31/32): librbd1-19.1.1-330.gc2ddf972.el9.x86_6 19 MB/s | 3.2 MB 00:00 2024-09-17T22:59:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 528 kB/s | 107 kB 00:00 2024-09-17T22:59:28.403 INFO:teuthology.orchestra.run.smithi152.stdout:(32/32): libarrow-9.0.0-11.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-09-17T22:59:28.407 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T22:59:28.407 INFO:teuthology.orchestra.run.smithi152.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-17T22:59:28.444 INFO:teuthology.orchestra.run.smithi005.stdout:(14/32): ceph-common-19.1.1-330.gc2ddf972.el9.x 11 MB/s | 21 MB 00:01 2024-09-17T22:59:28.469 INFO:teuthology.orchestra.run.smithi005.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 194 kB/s | 45 kB 00:00 2024-09-17T22:59:28.494 INFO:teuthology.orchestra.run.smithi005.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 369 kB/s | 160 kB 00:00 2024-09-17T22:59:28.511 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T22:59:28.547 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T22:59:28.547 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T22:59:28.553 INFO:teuthology.orchestra.run.smithi005.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 722 kB/s | 42 kB 00:00 2024-09-17T22:59:28.595 INFO:teuthology.orchestra.run.smithi005.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-17T22:59:28.654 INFO:teuthology.orchestra.run.smithi005.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-09-17T22:59:28.671 INFO:teuthology.orchestra.run.smithi005.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 478 kB/s | 36 kB 00:00 2024-09-17T22:59:28.730 INFO:teuthology.orchestra.run.smithi005.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-17T22:59:28.754 INFO:teuthology.orchestra.run.smithi005.stdout:(22/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2024-09-17T22:59:28.788 INFO:teuthology.orchestra.run.smithi005.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-17T22:59:28.822 INFO:teuthology.orchestra.run.smithi005.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-17T22:59:28.839 INFO:teuthology.orchestra.run.smithi005.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 342 kB/s | 26 kB 00:00 2024-09-17T22:59:28.864 INFO:teuthology.orchestra.run.smithi005.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-17T22:59:28.924 INFO:teuthology.orchestra.run.smithi005.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-17T22:59:29.023 INFO:teuthology.orchestra.run.smithi005.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-09-17T22:59:29.198 INFO:teuthology.orchestra.run.smithi005.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2024-09-17T22:59:29.223 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T22:59:29.224 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T22:59:29.307 INFO:teuthology.orchestra.run.smithi005.stdout:(30/32): librados2-19.1.1-330.gc2ddf972.el9.x86 12 MB/s | 3.4 MB 00:00 2024-09-17T22:59:29.415 INFO:teuthology.orchestra.run.smithi005.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-09-17T22:59:29.474 INFO:teuthology.orchestra.run.smithi005.stdout:(32/32): librbd1-19.1.1-330.gc2ddf972.el9.x86_6 11 MB/s | 3.2 MB 00:00 2024-09-17T22:59:29.479 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T22:59:29.479 INFO:teuthology.orchestra.run.smithi005.stdout:Total 19 MB/s | 60 MB 00:03 2024-09-17T22:59:29.592 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T22:59:29.633 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T22:59:29.633 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T22:59:30.365 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T22:59:30.365 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T22:59:30.763 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T22:59:30.847 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-17T22:59:30.875 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-17T22:59:30.908 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-17T22:59:30.931 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T22:59:30.955 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T22:59:31.149 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T22:59:31.203 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T22:59:31.544 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-17T22:59:31.659 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-17T22:59:31.744 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-17T22:59:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 8/34 2024-09-17T22:59:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-17T22:59:31.864 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T22:59:31.915 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-17T22:59:31.942 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-17T22:59:31.952 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-17T22:59:31.971 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-17T22:59:31.996 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 11/34 2024-09-17T22:59:31.996 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-17T22:59:32.019 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T22:59:32.048 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-17T22:59:32.064 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-17T22:59:32.088 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-17T22:59:32.152 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-17T22:59:32.186 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-17T22:59:32.247 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T22:59:32.301 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-17T22:59:32.305 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-17T22:59:32.337 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-17T22:59:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-17T22:59:32.402 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-17T22:59:32.439 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-17T22:59:32.476 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-17T22:59:32.710 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-17T22:59:32.764 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-17T22:59:32.794 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-17T22:59:32.843 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-17T22:59:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-17T22:59:32.934 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-17T22:59:32.947 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 8/34 2024-09-17T22:59:32.974 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-17T22:59:32.981 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 23/34 2024-09-17T22:59:33.017 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-17T22:59:33.029 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 9/34 2024-09-17T22:59:33.058 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-17T22:59:33.102 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 11/34 2024-09-17T22:59:33.180 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-17T22:59:33.210 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-17T22:59:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-17T22:59:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-17T22:59:33.421 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-17T22:59:33.477 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-17T22:59:33.506 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-17T22:59:33.525 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-17T22:59:33.529 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-17T22:59:33.558 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-17T22:59:33.588 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-17T22:59:33.589 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-17T22:59:33.621 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-17T22:59:33.660 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 27/34 2024-09-17T22:59:33.690 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 28/34 2024-09-17T22:59:33.951 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-17T22:59:33.991 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-17T22:59:34.084 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 22/34 2024-09-17T22:59:34.105 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 23/34 2024-09-17T22:59:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-17T22:59:34.677 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-17T22:59:34.702 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-17T22:59:34.782 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 26/34 2024-09-17T22:59:34.863 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 27/34 2024-09-17T22:59:34.897 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 28/34 2024-09-17T22:59:35.948 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-17T22:59:35.985 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-17T22:59:36.539 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-17T22:59:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-17T22:59:36.675 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-17T22:59:36.675 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T22:59:36.675 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T22:59:36.675 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:36.698 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-17T22:59:37.298 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-17T22:59:37.343 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-17T22:59:37.944 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 29/34 2024-09-17T22:59:38.013 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-17T22:59:38.091 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 30/34 2024-09-17T22:59:38.092 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T22:59:38.092 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T22:59:38.092 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:38.131 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-17T22:59:46.677 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-17T22:59:46.677 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-09-17T22:59:46.677 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-09-17T22:59:46.677 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-09-17T22:59:46.678 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-09-17T22:59:46.678 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-09-17T22:59:46.678 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-09-17T22:59:46.678 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-09-17T22:59:46.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:47.678 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-17T22:59:47.703 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-17T22:59:47.703 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T22:59:47.704 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T22:59:47.704 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T22:59:47.704 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T22:59:47.704 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:47.705 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T22:59:47.789 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T22:59:47.789 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T22:59:48.404 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-17T22:59:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /sys 2024-09-17T22:59:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /proc 2024-09-17T22:59:48.404 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /mnt 2024-09-17T22:59:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /var/tmp 2024-09-17T22:59:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /home 2024-09-17T22:59:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /root 2024-09-17T22:59:48.405 INFO:teuthology.orchestra.run.smithi005.stdout:skipping the directory /tmp 2024-09-17T22:59:48.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:48.978 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T22:59:48.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 1/34 2024-09-17T22:59:48.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2/34 2024-09-17T22:59:48.978 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 3/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 4/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 5/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 6/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 8/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 9/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 10/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 11/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-17T22:59:48.979 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-17T22:59:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-17T22:59:48.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-17T22:59:48.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-17T22:59:48.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-17T22:59:48.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-17T22:59:48.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 33/34 2024-09-17T22:59:49.427 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-17T22:59:49.454 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 32/34 2024-09-17T22:59:49.454 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T22:59:49.454 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T22:59:49.454 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T22:59:49.454 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T22:59:49.454 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:49.457 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T22:59:49.547 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-17T22:59:49.547 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T22:59:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T22:59:50.083 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:50.083 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T22:59:50.084 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.085 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:50.086 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T22:59:50.465 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-test 2024-09-17T22:59:50.782 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T22:59:50.782 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 1/34 2024-09-17T22:59:50.782 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 3/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 4/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 5/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 6/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 7/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x 8/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86 9/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 10/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 11/34 2024-09-17T22:59:50.783 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 12/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 13/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-17T22:59:50.784 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 31/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-17T22:59:50.785 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 33/34 2024-09-17T22:59:51.052 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T22:59:51.183 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T22:59:51.184 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:59:51.184 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T22:59:51.184 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:59:51.184 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T22:59:51.184 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 49 M 2024-09-17T22:59:51.184 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T22:59:51.184 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 163 k 2024-09-17T22:59:51.184 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T22:59:51.185 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T22:59:51.185 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:51.185 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T22:59:51.185 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T22:59:51.185 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-09-17T22:59:51.186 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T22:59:51.186 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 49 M 2024-09-17T22:59:51.187 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 209 M 2024-09-17T22:59:51.187 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T22:59:51.625 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.9 MB/s | 304 kB 00:00 2024-09-17T22:59:51.667 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-17T22:59:51.709 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): libcephsqlite-19.1.1-330.gc2ddf972.el9.x 670 kB/s | 163 kB 00:00 2024-09-17T22:59:51.796 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-17T22:59:51.796 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:51.796 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-09-17T22:59:51.796 INFO:teuthology.orchestra.run.smithi005.stdout: librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.796 INFO:teuthology.orchestra.run.smithi005.stdout: librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.796 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T22:59:51.796 INFO:teuthology.orchestra.run.smithi005.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-radosgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-selinux-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T22:59:51.797 INFO:teuthology.orchestra.run.smithi005.stdout: libradosstriper1-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.798 INFO:teuthology.orchestra.run.smithi005.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T22:59:51.798 INFO:teuthology.orchestra.run.smithi005.stdout: librgw2-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.798 INFO:teuthology.orchestra.run.smithi005.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T22:59:51.798 INFO:teuthology.orchestra.run.smithi005.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T22:59:51.798 INFO:teuthology.orchestra.run.smithi005.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T22:59:51.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-argparse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.798 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ceph-common-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T22:59:51.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.799 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T22:59:51.800 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T22:59:51.800 INFO:teuthology.orchestra.run.smithi005.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T22:59:51.800 INFO:teuthology.orchestra.run.smithi005.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T22:59:51.800 INFO:teuthology.orchestra.run.smithi005.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T22:59:51.801 INFO:teuthology.orchestra.run.smithi005.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T22:59:51.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:51.801 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T22:59:52.108 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-test 2024-09-17T22:59:52.707 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T22:59:52.848 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T22:59:52.849 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:59:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T22:59:52.849 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:59:52.849 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T22:59:52.849 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 49 M 2024-09-17T22:59:52.849 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T22:59:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 163 k 2024-09-17T22:59:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T22:59:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T22:59:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:52.850 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T22:59:52.850 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T22:59:52.850 INFO:teuthology.orchestra.run.smithi005.stdout:Install 4 Packages 2024-09-17T22:59:52.850 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T22:59:52.851 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 49 M 2024-09-17T22:59:52.851 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 209 M 2024-09-17T22:59:52.851 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T22:59:53.001 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): ceph-test-19.1.1-330.gc2ddf972.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-17T22:59:53.003 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T22:59:53.004 INFO:teuthology.orchestra.run.smithi152.stdout:Total 27 MB/s | 49 MB 00:01 2024-09-17T22:59:53.010 INFO:teuthology.orchestra.run.smithi005.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 2.3 MB/s | 304 kB 00:00 2024-09-17T22:59:53.032 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T22:59:53.044 INFO:teuthology.orchestra.run.smithi005.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2024-09-17T22:59:53.052 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T22:59:53.052 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T22:59:53.111 INFO:teuthology.orchestra.run.smithi005.stdout:(3/4): libcephsqlite-19.1.1-330.gc2ddf972.el9.x 708 kB/s | 163 kB 00:00 2024-09-17T22:59:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T22:59:53.438 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T22:59:53.972 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T22:59:54.062 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T22:59:54.109 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T22:59:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-17T22:59:54.419 INFO:teuthology.orchestra.run.smithi005.stdout:(4/4): ceph-test-19.1.1-330.gc2ddf972.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-17T22:59:54.421 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T22:59:54.422 INFO:teuthology.orchestra.run.smithi005.stdout:Total 31 MB/s | 49 MB 00:01 2024-09-17T22:59:54.450 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T22:59:54.473 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T22:59:54.473 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T22:59:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T22:59:54.882 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T22:59:55.433 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T22:59:55.524 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-17T22:59:55.562 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-17T22:59:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-17T22:59:58.756 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-17T22:59:58.843 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-17T23:00:00.478 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 3/4 2024-09-17T23:00:00.565 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-17T23:00:01.371 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-17T23:00:01.371 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 1/4 2024-09-17T23:00:01.371 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2/4 2024-09-17T23:00:01.371 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T23:00:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T23:00:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:01.698 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T23:00:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T23:00:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:01.699 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:01.967 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph 2024-09-17T23:00:02.561 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:02.696 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:02.698 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 6.5 k 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 2.4 M 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 1.5 M 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 249 k 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 4.7 M 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 17 M 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T23:00:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T23:00:02.700 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T23:00:02.701 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T23:00:02.702 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T23:00:02.702 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T23:00:02.702 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:02.702 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:02.702 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:02.702 INFO:teuthology.orchestra.run.smithi152.stdout:Install 37 Packages 2024-09-17T23:00:02.702 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:02.702 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 30 M 2024-09-17T23:00:02.703 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 108 M 2024-09-17T23:00:02.703 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 4/4 2024-09-17T23:00:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 1/4 2024-09-17T23:00:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2/4 2024-09-17T23:00:03.012 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-17T23:00:03.318 INFO:teuthology.orchestra.run.smithi152.stdout:(1/37): ceph-19.1.1-330.gc2ddf972.el9.x86_64.rp 49 kB/s | 6.5 kB 00:00 2024-09-17T23:00:03.356 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-17T23:00:03.357 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:03.357 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:00:03.357 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-test-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:03.357 INFO:teuthology.orchestra.run.smithi005.stdout: libcephsqlite-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:03.357 INFO:teuthology.orchestra.run.smithi005.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T23:00:03.357 INFO:teuthology.orchestra.run.smithi005.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T23:00:03.357 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:03.357 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:03.518 INFO:teuthology.orchestra.run.smithi152.stdout:(2/37): ceph-mgr-19.1.1-330.gc2ddf972.el9.x86_6 4.5 MB/s | 1.5 MB 00:00 2024-09-17T23:00:03.585 INFO:teuthology.orchestra.run.smithi152.stdout:(3/37): ceph-mds-19.1.1-330.gc2ddf972.el9.x86_6 5.9 MB/s | 2.4 MB 00:00 2024-09-17T23:00:03.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph 2024-09-17T23:00:03.652 INFO:teuthology.orchestra.run.smithi152.stdout:(4/37): ceph-mgr-modules-core-19.1.1-330.gc2ddf 3.7 MB/s | 249 kB 00:00 2024-09-17T23:00:03.877 INFO:teuthology.orchestra.run.smithi152.stdout:(5/37): ceph-mon-19.1.1-330.gc2ddf972.el9.x86_6 8.4 MB/s | 4.7 MB 00:00 2024-09-17T23:00:03.911 INFO:teuthology.orchestra.run.smithi152.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 978 kB/s | 253 kB 00:00 2024-09-17T23:00:03.986 INFO:teuthology.orchestra.run.smithi152.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-17T23:00:04.170 INFO:teuthology.orchestra.run.smithi152.stdout:(8/37): ceph-osd-19.1.1-330.gc2ddf972.el9.x86_6 26 MB/s | 17 MB 00:00 2024-09-17T23:00:04.195 INFO:teuthology.orchestra.run.smithi152.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 648 kB/s | 135 kB 00:00 2024-09-17T23:00:04.237 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:04.287 INFO:teuthology.orchestra.run.smithi152.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-17T23:00:04.371 INFO:teuthology.orchestra.run.smithi152.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 623 kB/s | 125 kB 00:00 2024-09-17T23:00:04.381 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:04.383 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: ceph x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 6.5 k 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 2.4 M 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 1.5 M 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 249 k 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 4.7 M 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 17 M 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T23:00:04.384 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T23:00:04.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T23:00:04.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout:Install 37 Packages 2024-09-17T23:00:04.387 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:04.388 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 30 M 2024-09-17T23:00:04.388 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 108 M 2024-09-17T23:00:04.388 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:00:04.446 INFO:teuthology.orchestra.run.smithi152.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.2 MB/s | 1.2 MB 00:00 2024-09-17T23:00:04.471 INFO:teuthology.orchestra.run.smithi152.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-09-17T23:00:04.522 INFO:teuthology.orchestra.run.smithi152.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-17T23:00:04.548 INFO:teuthology.orchestra.run.smithi152.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 346 kB/s | 35 kB 00:00 2024-09-17T23:00:04.583 INFO:teuthology.orchestra.run.smithi152.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 811 kB/s | 172 kB 00:00 2024-09-17T23:00:04.608 INFO:teuthology.orchestra.run.smithi152.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 675 kB/s | 42 kB 00:00 2024-09-17T23:00:04.634 INFO:teuthology.orchestra.run.smithi152.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 456 kB/s | 51 kB 00:00 2024-09-17T23:00:04.693 INFO:teuthology.orchestra.run.smithi152.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-17T23:00:04.717 INFO:teuthology.orchestra.run.smithi152.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 520 kB/s | 43 kB 00:00 2024-09-17T23:00:04.751 INFO:teuthology.orchestra.run.smithi152.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-09-17T23:00:04.810 INFO:teuthology.orchestra.run.smithi152.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-17T23:00:04.835 INFO:teuthology.orchestra.run.smithi152.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-09-17T23:00:04.860 INFO:teuthology.orchestra.run.smithi152.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 100 kB/s | 11 kB 00:00 2024-09-17T23:00:04.886 INFO:teuthology.orchestra.run.smithi152.stdout:(25/37): python3-jaraco-classes-3.2.1-5.el9.noa 239 kB/s | 18 kB 00:00 2024-09-17T23:00:04.911 INFO:teuthology.orchestra.run.smithi152.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 306 kB/s | 23 kB 00:00 2024-09-17T23:00:04.936 INFO:teuthology.orchestra.run.smithi152.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 257 kB/s | 19 kB 00:00 2024-09-17T23:00:04.961 INFO:teuthology.orchestra.run.smithi152.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-09-17T23:00:04.987 INFO:teuthology.orchestra.run.smithi152.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 924 kB/s | 46 kB 00:00 2024-09-17T23:00:05.013 INFO:teuthology.orchestra.run.smithi005.stdout:(1/37): ceph-19.1.1-330.gc2ddf972.el9.x86_64.rp 51 kB/s | 6.5 kB 00:00 2024-09-17T23:00:05.020 INFO:teuthology.orchestra.run.smithi152.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 943 kB/s | 79 kB 00:00 2024-09-17T23:00:05.054 INFO:teuthology.orchestra.run.smithi152.stdout:(31/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.8 MB/s | 90 kB 00:00 2024-09-17T23:00:05.087 INFO:teuthology.orchestra.run.smithi152.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.1 MB/s | 36 kB 00:00 2024-09-17T23:00:05.129 INFO:teuthology.orchestra.run.smithi152.stdout:(33/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-17T23:00:05.154 INFO:teuthology.orchestra.run.smithi152.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-17T23:00:05.188 INFO:teuthology.orchestra.run.smithi152.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 599 kB/s | 20 kB 00:00 2024-09-17T23:00:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:(2/37): ceph-mgr-19.1.1-330.gc2ddf972.el9.x86_6 4.5 MB/s | 1.5 MB 00:00 2024-09-17T23:00:05.230 INFO:teuthology.orchestra.run.smithi152.stdout:(36/37): python3-portend-3.1.0-2.el9.noarch.rpm 70 kB/s | 16 kB 00:00 2024-09-17T23:00:05.255 INFO:teuthology.orchestra.run.smithi152.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-09-17T23:00:05.258 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:05.258 INFO:teuthology.orchestra.run.smithi152.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-17T23:00:05.272 INFO:teuthology.orchestra.run.smithi005.stdout:(3/37): ceph-mds-19.1.1-330.gc2ddf972.el9.x86_6 6.2 MB/s | 2.4 MB 00:00 2024-09-17T23:00:05.331 INFO:teuthology.orchestra.run.smithi005.stdout:(4/37): ceph-mgr-modules-core-19.1.1-330.gc2ddf 4.2 MB/s | 249 kB 00:00 2024-09-17T23:00:05.411 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:05.423 INFO:teuthology.orchestra.run.smithi005.stdout:(5/37): ceph-mon-19.1.1-330.gc2ddf972.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-17T23:00:05.452 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:05.453 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:05.606 INFO:teuthology.orchestra.run.smithi005.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 920 kB/s | 253 kB 00:00 2024-09-17T23:00:05.657 INFO:teuthology.orchestra.run.smithi005.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-17T23:00:05.715 INFO:teuthology.orchestra.run.smithi005.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 4.2 MB/s | 1.2 MB 00:00 2024-09-17T23:00:05.741 INFO:teuthology.orchestra.run.smithi005.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-09-17T23:00:05.766 INFO:teuthology.orchestra.run.smithi005.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-17T23:00:05.799 INFO:teuthology.orchestra.run.smithi005.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-17T23:00:05.936 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:05.936 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:06.016 INFO:teuthology.orchestra.run.smithi005.stdout:(12/37): ceph-osd-19.1.1-330.gc2ddf972.el9.x86_ 21 MB/s | 17 MB 00:00 2024-09-17T23:00:06.566 INFO:teuthology.orchestra.run.smithi005.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 63 kB/s | 35 kB 00:00 2024-09-17T23:00:06.609 INFO:teuthology.orchestra.run.smithi005.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 224 kB/s | 188 kB 00:00 2024-09-17T23:00:06.725 INFO:teuthology.orchestra.run.smithi005.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 186 kB/s | 172 kB 00:00 2024-09-17T23:00:07.209 INFO:teuthology.orchestra.run.smithi005.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 85 kB/s | 51 kB 00:00 2024-09-17T23:00:07.234 INFO:teuthology.orchestra.run.smithi005.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 116 kB/s | 77 kB 00:00 2024-09-17T23:00:07.292 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:07.293 INFO:teuthology.orchestra.run.smithi005.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-17T23:00:07.318 INFO:teuthology.orchestra.run.smithi005.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 70 kB/s | 42 kB 00:00 2024-09-17T23:00:07.343 INFO:teuthology.orchestra.run.smithi005.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-17T23:00:07.350 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T23:00:07.377 INFO:teuthology.orchestra.run.smithi005.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 524 kB/s | 43 kB 00:00 2024-09-17T23:00:07.390 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T23:00:07.419 INFO:teuthology.orchestra.run.smithi005.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-17T23:00:07.427 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T23:00:07.453 INFO:teuthology.orchestra.run.smithi005.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 568 kB/s | 18 kB 00:00 2024-09-17T23:00:07.478 INFO:teuthology.orchestra.run.smithi005.stdout:(24/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-17T23:00:07.503 INFO:teuthology.orchestra.run.smithi005.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-17T23:00:07.505 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T23:00:07.528 INFO:teuthology.orchestra.run.smithi005.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 387 kB/s | 19 kB 00:00 2024-09-17T23:00:07.554 INFO:teuthology.orchestra.run.smithi005.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 392 kB/s | 20 kB 00:00 2024-09-17T23:00:07.567 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T23:00:07.579 INFO:teuthology.orchestra.run.smithi005.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-17T23:00:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T23:00:07.632 INFO:teuthology.orchestra.run.smithi005.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-17T23:00:07.655 INFO:teuthology.orchestra.run.smithi005.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.1 MB/s | 358 kB 00:00 2024-09-17T23:00:07.684 INFO:teuthology.orchestra.run.smithi005.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 318 kB/s | 16 kB 00:00 2024-09-17T23:00:07.708 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T23:00:07.709 INFO:teuthology.orchestra.run.smithi005.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.6 MB/s | 90 kB 00:00 2024-09-17T23:00:07.734 INFO:teuthology.orchestra.run.smithi005.stdout:(33/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-17T23:00:07.759 INFO:teuthology.orchestra.run.smithi005.stdout:(34/37): python3-tempora-5.0.0-2.el9.noarch.rpm 473 kB/s | 36 kB 00:00 2024-09-17T23:00:07.778 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T23:00:07.785 INFO:teuthology.orchestra.run.smithi005.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 801 kB/s | 20 kB 00:00 2024-09-17T23:00:07.810 INFO:teuthology.orchestra.run.smithi005.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-17T23:00:07.819 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T23:00:07.844 INFO:teuthology.orchestra.run.smithi005.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-17T23:00:07.849 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:07.849 INFO:teuthology.orchestra.run.smithi005.stdout:Total 8.8 MB/s | 30 MB 00:03 2024-09-17T23:00:07.854 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T23:00:07.884 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T23:00:07.919 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T23:00:07.961 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T23:00:08.001 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T23:00:08.004 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:00:08.036 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T23:00:08.050 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:00:08.050 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:00:08.071 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T23:00:08.118 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T23:00:08.151 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T23:00:08.223 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T23:00:08.378 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T23:00:08.458 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T23:00:08.511 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T23:00:08.545 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:00:08.546 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:00:08.550 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T23:00:08.599 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T23:00:08.663 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T23:00:08.857 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T23:00:08.905 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T23:00:08.981 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T23:00:09.079 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T23:00:09.120 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T23:00:09.235 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T23:00:09.391 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 32/37 2024-09-17T23:00:09.430 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-17T23:00:09.456 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-17T23:00:09.457 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:09.457 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T23:00:09.457 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T23:00:09.457 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T23:00:09.460 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:09.942 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:00:10.005 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-17T23:00:10.039 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-17T23:00:10.066 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-17T23:00:10.141 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-17T23:00:10.182 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-17T23:00:10.215 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-17T23:00:10.310 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-17T23:00:10.396 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-17T23:00:10.443 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-17T23:00:10.478 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-17T23:00:10.507 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-17T23:00:10.542 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-17T23:00:10.583 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-17T23:00:10.624 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-17T23:00:10.668 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-17T23:00:10.702 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-17T23:00:10.751 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-17T23:00:10.791 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-17T23:00:10.869 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-17T23:00:10.906 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-17T23:00:10.934 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-17T23:00:10.934 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:10.934 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T23:00:10.934 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T23:00:10.934 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T23:00:10.934 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:11.020 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-17T23:00:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-17T23:00:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-17T23:00:11.199 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-17T23:00:11.261 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-17T23:00:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-17T23:00:11.373 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-17T23:00:11.397 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-17T23:00:11.397 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:11.397 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T23:00:11.398 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T23:00:11.398 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T23:00:11.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:11.522 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-17T23:00:11.582 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-17T23:00:11.624 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-17T23:00:11.648 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-17T23:00:11.648 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:11.648 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T23:00:11.648 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T23:00:11.648 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T23:00:11.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:11.654 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-17T23:00:11.720 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-17T23:00:11.751 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-17T23:00:11.798 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-17T23:00:11.929 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-17T23:00:12.093 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 32/37 2024-09-17T23:00:12.124 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-17T23:00:12.152 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 33/37 2024-09-17T23:00:12.152 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:12.153 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T23:00:12.153 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T23:00:12.153 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T23:00:12.153 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:13.458 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 1/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 3/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 4/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 5/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 6/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T23:00:13.459 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T23:00:13.460 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T23:00:13.461 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T23:00:13.462 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T23:00:13.683 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-17T23:00:13.712 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 34/37 2024-09-17T23:00:13.712 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:13.712 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T23:00:13.712 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T23:00:13.712 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T23:00:13.713 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:14.175 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-17T23:00:14.201 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 35/37 2024-09-17T23:00:14.201 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:14.201 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T23:00:14.201 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T23:00:14.201 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T23:00:14.201 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:14.348 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T23:00:14.349 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T23:00:14.350 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:14.351 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:14.451 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-17T23:00:14.476 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 36/37 2024-09-17T23:00:14.476 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:14.476 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T23:00:14.477 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T23:00:14.477 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T23:00:14.477 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:14.543 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-17T23:00:14.730 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-base 2024-09-17T23:00:15.318 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:52 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:15.408 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:00:15.450 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:15.451 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:00:15.451 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:15.517 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install cephadm 2024-09-17T23:00:16.091 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:53 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:16.224 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:16.224 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 765 k 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 765 k 2024-09-17T23:00:16.225 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 771 k 2024-09-17T23:00:16.226 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 37/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 1/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 3/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 4/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 5/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.n 6/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-17T23:00:16.367 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-17T23:00:16.368 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-17T23:00:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-17T23:00:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-17T23:00:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-17T23:00:16.369 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-17T23:00:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-17T23:00:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-17T23:00:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-17T23:00:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-17T23:00:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-17T23:00:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-17T23:00:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-17T23:00:16.370 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-17T23:00:16.480 INFO:teuthology.orchestra.run.smithi152.stdout:cephadm-19.1.1-330.gc2ddf972.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-17T23:00:16.481 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:16.481 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-17T23:00:16.482 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:16.487 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:16.487 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:16.492 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:16.493 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:16.567 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:16.949 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:17.041 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:17.282 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-17T23:00:17.282 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mds-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-modules-core-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mon-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-osd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T23:00:17.283 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T23:00:17.284 INFO:teuthology.orchestra.run.smithi005.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:17.285 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:17.422 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:17.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-base 2024-09-17T23:00:17.694 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:17.694 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:17.695 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:17.695 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:17.695 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:17.695 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:17.908 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T23:00:18.238 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:54 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:18.330 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-base-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:00:18.375 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:18.376 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:00:18.376 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:18.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install cephadm 2024-09-17T23:00:18.498 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:18.632 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 145 k 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 145 k 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 435 k 2024-09-17T23:00:18.633 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:18.927 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-immutable-object-cache-19.1.1-330.gc2ddf97 496 kB/s | 145 kB 00:00 2024-09-17T23:00:18.927 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:18.928 INFO:teuthology.orchestra.run.smithi152.stdout:Total 493 kB/s | 145 kB 00:00 2024-09-17T23:00:18.928 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:18.935 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:18.936 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:18.993 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:18.993 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:19.035 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:55 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:19.154 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:19.172 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:19.173 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:19.173 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T23:00:19.173 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 765 k 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 765 k 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 771 k 2024-09-17T23:00:19.174 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:00:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-17T23:00:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-17T23:00:19.278 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:19.278 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T23:00:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:19.668 INFO:teuthology.orchestra.run.smithi005.stdout:cephadm-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.5 MB/s | 765 kB 00:00 2024-09-17T23:00:19.668 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:19.668 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.5 MB/s | 765 kB 00:00 2024-09-17T23:00:19.669 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:00:19.674 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:00:19.675 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:00:19.681 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:00:19.681 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:00:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:00:20.224 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:20.236 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-17T23:00:20.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:20.237 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:20.237 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:20.237 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:20.237 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:20.325 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:20.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr 2024-09-17T23:00:20.675 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:20.921 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:00:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:20.921 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:20.921 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:21.089 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:21.128 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-immutable-object-cache 2024-09-17T23:00:21.179 INFO:teuthology.orchestra.run.smithi152.stdout:Package ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:00:21.221 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:21.222 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:00:21.222 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:21.292 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T23:00:21.737 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:00:57 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:58 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:21.874 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:21.875 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-09-17T23:00:21.875 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:21.875 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:00:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 145 k 2024-09-17T23:00:21.875 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:21.876 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:00:21.876 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:21.876 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-17T23:00:21.876 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:21.876 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 145 k 2024-09-17T23:00:21.876 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 435 k 2024-09-17T23:00:21.876 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:00:21.997 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:21.998 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:21.998 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 3.6 M 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 32 k 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 16 k 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T23:00:21.999 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout:Install 12 Packages 2024-09-17T23:00:22.000 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:22.001 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 8.7 M 2024-09-17T23:00:22.001 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 104 M 2024-09-17T23:00:22.001 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:22.091 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-immutable-object-cache-19.1.1-330.gc2ddf97 679 kB/s | 145 kB 00:00 2024-09-17T23:00:22.091 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:22.092 INFO:teuthology.orchestra.run.smithi005.stdout:Total 674 kB/s | 145 kB 00:00 2024-09-17T23:00:22.092 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:00:22.100 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:00:22.100 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:00:22.161 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:00:22.161 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:00:22.324 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:00:22.417 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-17T23:00:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-17T23:00:22.444 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:22.444 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T23:00:22.444 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:22.688 INFO:teuthology.orchestra.run.smithi152.stdout:(1/12): ceph-grafana-dashboards-19.1.1-330.gc2d 214 kB/s | 32 kB 00:00 2024-09-17T23:00:22.705 INFO:teuthology.orchestra.run.smithi152.stdout:(2/12): ceph-prometheus-alerts-19.1.1-330.gc2dd 99 kB/s | 16 kB 00:00 2024-09-17T23:00:22.839 INFO:teuthology.orchestra.run.smithi152.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.0 MB/s | 269 kB 00:00 2024-09-17T23:00:22.939 INFO:teuthology.orchestra.run.smithi152.stdout:(4/12): ceph-mgr-dashboard-19.1.1-330.gc2ddf972 8.9 MB/s | 3.6 MB 00:00 2024-09-17T23:00:22.974 INFO:teuthology.orchestra.run.smithi152.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2024-09-17T23:00:23.023 INFO:teuthology.orchestra.run.smithi152.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 390 kB/s | 19 kB 00:00 2024-09-17T23:00:23.115 INFO:teuthology.orchestra.run.smithi152.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 3.1 MB/s | 548 kB 00:00 2024-09-17T23:00:23.157 INFO:teuthology.orchestra.run.smithi152.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.4 MB/s | 144 kB 00:00 2024-09-17T23:00:23.173 INFO:teuthology.orchestra.run.smithi152.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.8 MB/s | 31 kB 00:00 2024-09-17T23:00:23.207 INFO:teuthology.orchestra.run.smithi152.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-17T23:00:23.232 INFO:teuthology.orchestra.run.smithi152.stdout:(11/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.1 MB/s | 863 kB 00:00 2024-09-17T23:00:23.342 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.e 1/1 2024-09-17T23:00:23.342 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:23.342 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:00:23.342 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-immutable-object-cache-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:00:23.342 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:23.342 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:23.366 INFO:teuthology.orchestra.run.smithi152.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.0 MB/s | 2.0 MB 00:00 2024-09-17T23:00:23.370 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:23.370 INFO:teuthology.orchestra.run.smithi152.stdout:Total 6.3 MB/s | 8.7 MB 00:01 2024-09-17T23:00:23.422 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:23.441 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:23.441 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:23.579 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr 2024-09-17T23:00:23.639 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:23.639 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:24.186 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:00 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:24.192 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:24.266 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T23:00:24.278 INFO:teuthology.orchestra.run.smithi005.stdout:Package ceph-mgr-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:00:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T23:00:24.323 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:24.324 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:00:24.324 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T23:00:24.387 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T23:00:24.403 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-dashboard 2024-09-17T23:00:24.482 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T23:00:24.613 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T23:00:24.698 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T23:00:24.758 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T23:00:24.787 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T23:00:24.818 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 10/12 2024-09-17T23:00:25.008 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:01 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:25.145 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 3.6 M 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 32 k 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 16 k 2024-09-17T23:00:25.146 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout:Install 12 Packages 2024-09-17T23:00:25.147 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:25.148 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 8.7 M 2024-09-17T23:00:25.148 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 104 M 2024-09-17T23:00:25.148 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:00:25.869 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 11/12 2024-09-17T23:00:25.902 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-17T23:00:26.031 INFO:teuthology.orchestra.run.smithi005.stdout:(1/12): ceph-grafana-dashboards-19.1.1-330.gc2d 212 kB/s | 32 kB 00:00 2024-09-17T23:00:26.056 INFO:teuthology.orchestra.run.smithi005.stdout:(2/12): ceph-prometheus-alerts-19.1.1-330.gc2dd 94 kB/s | 16 kB 00:00 2024-09-17T23:00:26.198 INFO:teuthology.orchestra.run.smithi005.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.9 MB/s | 269 kB 00:00 2024-09-17T23:00:26.248 INFO:teuthology.orchestra.run.smithi005.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.6 MB/s | 1.0 MB 00:00 2024-09-17T23:00:26.315 INFO:teuthology.orchestra.run.smithi005.stdout:(5/12): ceph-mgr-dashboard-19.1.1-330.gc2ddf972 8.2 MB/s | 3.6 MB 00:00 2024-09-17T23:00:26.374 INFO:teuthology.orchestra.run.smithi005.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 347 kB/s | 19 kB 00:00 2024-09-17T23:00:26.432 INFO:teuthology.orchestra.run.smithi005.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.9 MB/s | 548 kB 00:00 2024-09-17T23:00:26.483 INFO:teuthology.orchestra.run.smithi005.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.8 MB/s | 144 kB 00:00 2024-09-17T23:00:26.516 INFO:teuthology.orchestra.run.smithi005.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 923 kB/s | 31 kB 00:00 2024-09-17T23:00:26.558 INFO:teuthology.orchestra.run.smithi005.stdout:(10/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.3 MB/s | 863 kB 00:00 2024-09-17T23:00:26.583 INFO:teuthology.orchestra.run.smithi005.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-09-17T23:00:26.750 INFO:teuthology.orchestra.run.smithi005.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.4 MB/s | 2.0 MB 00:00 2024-09-17T23:00:26.755 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:26.755 INFO:teuthology.orchestra.run.smithi005.stdout:Total 5.4 MB/s | 8.7 MB 00:01 2024-09-17T23:00:26.808 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:00:26.828 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:00:26.828 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:00:27.048 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:00:27.048 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:00:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-17T23:00:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 1/12 2024-09-17T23:00:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 2/12 2024-09-17T23:00:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 3/12 2024-09-17T23:00:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T23:00:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T23:00:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T23:00:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T23:00:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T23:00:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T23:00:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T23:00:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T23:00:27.627 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T23:00:27.628 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T23:00:27.628 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T23:00:27.628 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T23:00:27.628 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T23:00:27.628 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:27.628 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:27.718 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:00:27.793 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-17T23:00:27.828 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-17T23:00:27.876 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-17T23:00:27.885 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T23:00:27.905 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-17T23:00:28.005 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-17T23:00:28.138 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-17T23:00:28.237 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-17T23:00:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-17T23:00:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-17T23:00:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 10/12 2024-09-17T23:00:28.466 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:05 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:28.598 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 7.4 M 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T23:00:28.599 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================== 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout:Install 12 Packages 2024-09-17T23:00:28.600 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:28.601 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 38 M 2024-09-17T23:00:28.601 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 212 M 2024-09-17T23:00:28.601 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:28.906 INFO:teuthology.orchestra.run.smithi152.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-17T23:00:28.956 INFO:teuthology.orchestra.run.smithi152.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-17T23:00:29.257 INFO:teuthology.orchestra.run.smithi152.stdout:(3/12): ceph-mgr-diskprediction-local-19.1.1-33 15 MB/s | 7.4 MB 00:00 2024-09-17T23:00:29.466 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 11/12 2024-09-17T23:00:29.512 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-17T23:00:29.515 INFO:teuthology.orchestra.run.smithi152.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 54 kB/s | 33 kB 00:00 2024-09-17T23:00:29.740 INFO:teuthology.orchestra.run.smithi152.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 38 kB/s | 18 kB 00:00 2024-09-17T23:00:30.090 INFO:teuthology.orchestra.run.smithi152.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 67 kB/s | 38 kB 00:00 2024-09-17T23:00:30.183 INFO:teuthology.orchestra.run.smithi152.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.4 MB/s | 3.0 MB 00:01 2024-09-17T23:00:30.858 INFO:teuthology.orchestra.run.smithi152.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.5 MB/s | 4.9 MB 00:01 2024-09-17T23:00:30.883 INFO:teuthology.orchestra.run.smithi152.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 309 kB/s | 245 kB 00:00 2024-09-17T23:00:30.906 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 12/12 2024-09-17T23:00:30.906 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9 1/12 2024-09-17T23:00:30.906 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noar 2/12 2024-09-17T23:00:30.906 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9. 3/12 2024-09-17T23:00:30.906 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-17T23:00:30.907 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-17T23:00:30.907 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-17T23:00:30.907 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-17T23:00:30.907 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-17T23:00:30.907 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-17T23:00:30.907 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-17T23:00:30.907 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-17T23:00:31.242 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-17T23:00:31.242 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-grafana-dashboards-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-dashboard-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-prometheus-alerts-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T23:00:31.243 INFO:teuthology.orchestra.run.smithi005.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T23:00:31.244 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:31.244 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:31.350 INFO:teuthology.orchestra.run.smithi152.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.4 MB/s | 5.1 MB 00:01 2024-09-17T23:00:31.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-17T23:00:31.650 INFO:teuthology.orchestra.run.smithi152.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 317 kB/s | 250 kB 00:00 2024-09-17T23:00:32.080 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:08 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:32.220 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 7.4 M 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T23:00:32.221 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:00:32.222 INFO:teuthology.orchestra.run.smithi005.stdout:====================================================================================== 2024-09-17T23:00:32.223 INFO:teuthology.orchestra.run.smithi005.stdout:Install 12 Packages 2024-09-17T23:00:32.223 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:32.223 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 38 M 2024-09-17T23:00:32.223 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 212 M 2024-09-17T23:00:32.223 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:00:32.334 INFO:teuthology.orchestra.run.smithi152.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-17T23:00:32.335 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:32.335 INFO:teuthology.orchestra.run.smithi152.stdout:Total 10 MB/s | 38 MB 00:03 2024-09-17T23:00:32.694 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:32.721 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:32.721 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:32.783 INFO:teuthology.orchestra.run.smithi005.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-33 16 MB/s | 7.4 MB 00:00 2024-09-17T23:00:32.892 INFO:teuthology.orchestra.run.smithi005.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 334 kB/s | 191 kB 00:00 2024-09-17T23:00:32.917 INFO:teuthology.orchestra.run.smithi005.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-17T23:00:33.034 INFO:teuthology.orchestra.run.smithi005.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 156 kB/s | 18 kB 00:00 2024-09-17T23:00:33.118 INFO:teuthology.orchestra.run.smithi005.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 463 kB/s | 38 kB 00:00 2024-09-17T23:00:33.143 INFO:teuthology.orchestra.run.smithi005.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 973 kB/s | 801 kB 00:00 2024-09-17T23:00:33.164 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:33.165 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:33.343 INFO:teuthology.orchestra.run.smithi005.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-17T23:00:33.744 INFO:teuthology.orchestra.run.smithi005.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.5 MB/s | 3.0 MB 00:00 2024-09-17T23:00:33.886 INFO:teuthology.orchestra.run.smithi005.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.7 MB/s | 250 kB 00:00 2024-09-17T23:00:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T23:00:34.048 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T23:00:34.149 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T23:00:34.191 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T23:00:34.379 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T23:00:34.415 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T23:00:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T23:00:35.069 INFO:teuthology.orchestra.run.smithi005.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.0 MB/s | 5.1 MB 00:01 2024-09-17T23:00:35.136 INFO:teuthology.orchestra.run.smithi005.stdout:(11/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 2.4 MB/s | 4.9 MB 00:02 2024-09-17T23:00:35.159 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T23:00:35.279 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T23:00:36.545 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T23:00:37.590 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T23:00:37.613 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-17T23:00:38.636 INFO:teuthology.orchestra.run.smithi005.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.4 MB/s | 16 MB 00:04 2024-09-17T23:00:38.636 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:38.637 INFO:teuthology.orchestra.run.smithi005.stdout:Total 6.0 MB/s | 38 MB 00:06 2024-09-17T23:00:39.009 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:00:39.037 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:00:39.037 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:00:39.496 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:00:39.497 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:00:40.229 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-17T23:00:40.229 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 1/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T23:00:40.230 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T23:00:40.293 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:00:40.368 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-17T23:00:40.518 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-17T23:00:40.623 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-17T23:00:40.661 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T23:00:40.702 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T23:00:40.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T23:00:40.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T23:00:40.703 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T23:00:40.703 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:40.703 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:40.854 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-17T23:00:40.884 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-17T23:00:40.964 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-17T23:00:41.082 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-rook 2024-09-17T23:00:41.670 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-17T23:00:41.677 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:18 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:41.787 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-17T23:00:41.809 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 49 k 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T23:00:41.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout:Install 13 Packages 2024-09-17T23:00:41.812 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:41.813 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 2.2 M 2024-09-17T23:00:41.816 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 26 M 2024-09-17T23:00:41.816 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:42.047 INFO:teuthology.orchestra.run.smithi152.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 204 kB/s | 26 kB 00:00 2024-09-17T23:00:42.072 INFO:teuthology.orchestra.run.smithi152.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 127 kB/s | 19 kB 00:00 2024-09-17T23:00:42.097 INFO:teuthology.orchestra.run.smithi152.stdout:(3/13): ceph-mgr-rook-19.1.1-330.gc2ddf972.el9. 280 kB/s | 49 kB 00:00 2024-09-17T23:00:42.189 INFO:teuthology.orchestra.run.smithi152.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-17T23:00:42.214 INFO:teuthology.orchestra.run.smithi152.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-09-17T23:00:42.239 INFO:teuthology.orchestra.run.smithi152.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T23:00:42.264 INFO:teuthology.orchestra.run.smithi152.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 640 kB/s | 32 kB 00:00 2024-09-17T23:00:42.298 INFO:teuthology.orchestra.run.smithi152.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.4 MB/s | 279 kB 00:00 2024-09-17T23:00:42.315 INFO:teuthology.orchestra.run.smithi152.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 191 kB/s | 14 kB 00:00 2024-09-17T23:00:42.357 INFO:teuthology.orchestra.run.smithi152.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-17T23:00:42.374 INFO:teuthology.orchestra.run.smithi152.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-17T23:00:42.399 INFO:teuthology.orchestra.run.smithi152.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2024-09-17T23:00:42.525 INFO:teuthology.orchestra.run.smithi152.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.5 MB/s | 1.0 MB 00:00 2024-09-17T23:00:42.527 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:42.527 INFO:teuthology.orchestra.run.smithi152.stdout:Total 3.1 MB/s | 2.2 MB 00:00 2024-09-17T23:00:42.591 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:42.606 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:42.606 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:42.698 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:42.723 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:43.115 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T23:00:43.235 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:43.408 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T23:00:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T23:00:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T23:00:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T23:00:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T23:00:43.704 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T23:00:43.813 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T23:00:43.869 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T23:00:44.221 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-17T23:00:44.251 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-17T23:00:44.604 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T23:00:44.658 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T23:00:44.692 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T23:00:44.740 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T23:00:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-17T23:00:45.610 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-17T23:00:45.610 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 1/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T23:00:45.611 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T23:00:45.957 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T23:00:45.957 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:45.957 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:45.957 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:45.957 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T23:00:45.957 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T23:00:45.957 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T23:00:45.957 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:45.958 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:46.230 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 12/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf9 1/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-17T23:00:46.812 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-17T23:00:46.813 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-17T23:00:46.813 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-17T23:00:46.817 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:23 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:46.951 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:46.951 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:46.951 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 146 k 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:46.952 INFO:teuthology.orchestra.run.smithi152.stdout:Install 6 Packages 2024-09-17T23:00:46.953 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:46.953 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 7.0 M 2024-09-17T23:00:46.953 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 33 M 2024-09-17T23:00:46.953 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:47.384 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-diskprediction-local-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T23:00:47.385 INFO:teuthology.orchestra.run.smithi005.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T23:00:47.386 INFO:teuthology.orchestra.run.smithi005.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T23:00:47.386 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:47.386 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:47.626 INFO:teuthology.orchestra.run.smithi152.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-17T23:00:47.693 INFO:teuthology.orchestra.run.smithi152.stdout:(2/6): ceph-mgr-cephadm-19.1.1-330.gc2ddf972.el 483 kB/s | 146 kB 00:00 2024-09-17T23:00:47.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-rook 2024-09-17T23:00:47.752 INFO:teuthology.orchestra.run.smithi152.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 992 kB/s | 58 kB 00:00 2024-09-17T23:00:47.793 INFO:teuthology.orchestra.run.smithi152.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 3.2 MB/s | 548 kB 00:00 2024-09-17T23:00:47.818 INFO:teuthology.orchestra.run.smithi152.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-17T23:00:48.329 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:24 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:48.469 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T23:00:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:00:48.470 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 49 k 2024-09-17T23:00:48.470 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T23:00:48.471 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T23:00:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:00:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:Install 13 Packages 2024-09-17T23:00:48.472 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 2.2 M 2024-09-17T23:00:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 26 M 2024-09-17T23:00:48.472 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:00:49.319 INFO:teuthology.orchestra.run.smithi005.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 184 kB/s | 19 kB 00:00 2024-09-17T23:00:49.344 INFO:teuthology.orchestra.run.smithi005.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 198 kB/s | 26 kB 00:00 2024-09-17T23:00:49.378 INFO:teuthology.orchestra.run.smithi005.stdout:(3/13): ceph-mgr-rook-19.1.1-330.gc2ddf972.el9. 303 kB/s | 49 kB 00:00 2024-09-17T23:00:49.587 INFO:teuthology.orchestra.run.smithi005.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 656 kB/s | 159 kB 00:00 2024-09-17T23:00:49.612 INFO:teuthology.orchestra.run.smithi005.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 760 kB/s | 222 kB 00:00 2024-09-17T23:00:49.637 INFO:teuthology.orchestra.run.smithi005.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-17T23:00:49.679 INFO:teuthology.orchestra.run.smithi005.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-17T23:00:49.704 INFO:teuthology.orchestra.run.smithi005.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 212 kB/s | 14 kB 00:00 2024-09-17T23:00:49.730 INFO:teuthology.orchestra.run.smithi005.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.5 MB/s | 220 kB 00:00 2024-09-17T23:00:49.763 INFO:teuthology.orchestra.run.smithi005.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 724 kB/s | 279 kB 00:00 2024-09-17T23:00:49.789 INFO:teuthology.orchestra.run.smithi005.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-17T23:00:49.847 INFO:teuthology.orchestra.run.smithi005.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.1 MB/s | 90 kB 00:00 2024-09-17T23:00:49.902 INFO:teuthology.orchestra.run.smithi152.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.4 MB/s | 6.0 MB 00:02 2024-09-17T23:00:49.905 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:49.905 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.4 MB/s | 7.0 MB 00:02 2024-09-17T23:00:49.905 INFO:teuthology.orchestra.run.smithi005.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-09-17T23:00:49.909 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:49.909 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.5 MB/s | 2.2 MB 00:01 2024-09-17T23:00:49.978 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:49.984 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:00:49.990 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:49.991 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:50.000 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:00:50.001 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:00:50.090 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:50.091 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:50.099 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:00:50.101 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:00:50.407 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:50.566 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T23:00:50.619 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:00:50.620 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T23:00:50.795 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-17T23:00:50.850 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-17T23:00:50.914 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-17T23:00:50.950 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-17T23:00:50.993 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-17T23:00:51.106 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-17T23:00:51.145 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T23:00:51.216 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-17T23:00:51.238 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T23:00:51.269 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-17T23:00:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T23:00:51.332 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-17T23:00:52.023 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-17T23:00:52.074 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-17T23:00:52.093 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-17T23:00:52.094 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/6 2024-09-17T23:00:52.094 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T23:00:52.094 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T23:00:52.094 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T23:00:52.094 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T23:00:52.108 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-17T23:00:52.157 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-17T23:00:52.186 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T23:00:52.381 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:52.382 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:52.632 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-fuse 2024-09-17T23:00:52.965 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 13/13 2024-09-17T23:00:52.965 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 1/13 2024-09-17T23:00:52.965 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-17T23:00:52.965 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-17T23:00:52.965 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-17T23:00:52.966 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-17T23:00:52.966 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-17T23:00:52.966 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-17T23:00:52.966 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-17T23:00:52.966 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-17T23:00:52.966 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-17T23:00:52.966 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-17T23:00:52.966 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-17T23:00:53.208 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:53.297 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-rook-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T23:00:53.298 INFO:teuthology.orchestra.run.smithi005.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T23:00:53.299 INFO:teuthology.orchestra.run.smithi005.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T23:00:53.299 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T23:00:53.299 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T23:00:53.299 INFO:teuthology.orchestra.run.smithi005.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T23:00:53.299 INFO:teuthology.orchestra.run.smithi005.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T23:00:53.299 INFO:teuthology.orchestra.run.smithi005.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T23:00:53.299 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:53.299 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:53.342 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:53.342 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 897 k 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout:Install 2 Packages 2024-09-17T23:00:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:53.344 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 977 k 2024-09-17T23:00:53.344 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 2.9 M 2024-09-17T23:00:53.344 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:53.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-mgr-cephadm 2024-09-17T23:00:53.570 INFO:teuthology.orchestra.run.smithi152.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 446 kB/s | 80 kB 00:00 2024-09-17T23:00:53.645 INFO:teuthology.orchestra.run.smithi152.stdout:(2/2): ceph-fuse-19.1.1-330.gc2ddf972.el9.x86_6 3.5 MB/s | 897 kB 00:00 2024-09-17T23:00:53.645 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:53.646 INFO:teuthology.orchestra.run.smithi152.stdout:Total 3.2 MB/s | 977 kB 00:00 2024-09-17T23:00:53.657 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:53.678 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:53.679 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:53.760 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:53.760 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:53.949 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:54.097 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T23:00:54.153 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:30 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-17T23:00:54.290 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:54.290 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:54.290 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 146 k 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:00:54.291 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:54.292 INFO:teuthology.orchestra.run.smithi005.stdout:Install 6 Packages 2024-09-17T23:00:54.292 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:54.292 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 7.0 M 2024-09-17T23:00:54.292 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 33 M 2024-09-17T23:00:54.292 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:00:54.584 INFO:teuthology.orchestra.run.smithi005.stdout:(1/6): ceph-mgr-cephadm-19.1.1-330.gc2ddf972.el 685 kB/s | 146 kB 00:00 2024-09-17T23:00:54.667 INFO:teuthology.orchestra.run.smithi005.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-17T23:00:54.692 INFO:teuthology.orchestra.run.smithi005.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-17T23:00:54.718 INFO:teuthology.orchestra.run.smithi005.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-17T23:00:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-17T23:00:54.870 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/2 2024-09-17T23:00:55.010 INFO:teuthology.orchestra.run.smithi005.stdout:(5/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 388 kB/s | 248 kB 00:00 2024-09-17T23:00:55.132 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T23:00:55.132 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:55.132 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:55.133 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T23:00:55.133 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:55.133 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:55.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-volume 2024-09-17T23:00:55.743 INFO:teuthology.orchestra.run.smithi005.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.3 MB/s | 6.0 MB 00:01 2024-09-17T23:00:55.745 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:55.745 INFO:teuthology.orchestra.run.smithi005.stdout:Total 4.8 MB/s | 7.0 MB 00:01 2024-09-17T23:00:55.821 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:00:55.833 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:00:55.833 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:00:55.940 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:00:55.940 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:00:56.043 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:33 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:56.176 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:56.177 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:56.177 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-09-17T23:00:56.177 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 285 k 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 285 k 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 1.3 M 2024-09-17T23:00:56.178 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:56.382 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-volume-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.4 MB/s | 285 kB 00:00 2024-09-17T23:00:56.383 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:56.383 INFO:teuthology.orchestra.run.smithi152.stdout:Total 1.4 MB/s | 285 kB 00:00 2024-09-17T23:00:56.383 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:56.387 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:00:56.391 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:56.391 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:56.416 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:56.416 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:56.570 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-17T23:00:56.622 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-17T23:00:56.634 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:56.709 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:56.725 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:56.725 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:00:56.725 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T23:00:56.725 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:57.172 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-17T23:00:57.268 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-17T23:00:57.339 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-17T23:00:57.366 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-17T23:00:57.748 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:00:57.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:57.749 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:00:57.749 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:57.749 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:57.749 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:00:58.072 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados-devel 2024-09-17T23:00:58.117 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 6/6 2024-09-17T23:00:58.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 1/6 2024-09-17T23:00:58.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-17T23:00:58.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-17T23:00:58.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-17T23:00:58.118 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-17T23:00:58.405 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-17T23:00:58.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:58.405 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:00:58.405 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-mgr-cephadm-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:00:58.405 INFO:teuthology.orchestra.run.smithi005.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T23:00:58.405 INFO:teuthology.orchestra.run.smithi005.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T23:00:58.405 INFO:teuthology.orchestra.run.smithi005.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T23:00:58.406 INFO:teuthology.orchestra.run.smithi005.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T23:00:58.406 INFO:teuthology.orchestra.run.smithi005.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T23:00:58.406 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:58.406 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:00:58.663 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-fuse 2024-09-17T23:00:58.670 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:00:58.803 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:00:58.804 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:58.804 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-17T23:00:58.804 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:58.804 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:00:58.804 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 127 k 2024-09-17T23:00:58.805 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:58.805 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:00:58.805 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:00:58.805 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-17T23:00:58.805 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:00:58.805 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 127 k 2024-09-17T23:00:58.805 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 456 k 2024-09-17T23:00:58.805 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:00:59.078 INFO:teuthology.orchestra.run.smithi152.stdout:librados-devel-19.1.1-330.gc2ddf972.el9.x86_64. 465 kB/s | 127 kB 00:00 2024-09-17T23:00:59.078 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:59.079 INFO:teuthology.orchestra.run.smithi152.stdout:Total 462 kB/s | 127 kB 00:00 2024-09-17T23:00:59.079 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:00:59.084 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:00:59.084 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:00:59.148 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:00:59.148 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:00:59.264 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:35 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:00:59.305 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:00:59.404 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:00:59.404 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:59.404 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T23:00:59.404 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:59.404 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:00:59.404 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 897 k 2024-09-17T23:00:59.405 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-09-17T23:00:59.405 INFO:teuthology.orchestra.run.smithi005.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T23:00:59.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:59.405 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:00:59.405 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:00:59.405 INFO:teuthology.orchestra.run.smithi005.stdout:Install 2 Packages 2024-09-17T23:00:59.405 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:00:59.406 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 977 k 2024-09-17T23:00:59.406 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 2.9 M 2024-09-17T23:00:59.406 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:00:59.408 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:00:59.529 INFO:teuthology.orchestra.run.smithi005.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 785 kB/s | 80 kB 00:00 2024-09-17T23:00:59.704 INFO:teuthology.orchestra.run.smithi005.stdout:(2/2): ceph-fuse-19.1.1-330.gc2ddf972.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-17T23:00:59.704 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:00:59.705 INFO:teuthology.orchestra.run.smithi005.stdout:Total 3.2 MB/s | 977 kB 00:00 2024-09-17T23:00:59.717 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:00:59.740 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:00:59.740 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:00:59.827 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:00:59.828 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:00:59.833 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:00.020 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:01:00.146 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:00.146 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:00.146 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:01:00.146 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:00.147 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:00.147 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:00.167 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-17T23:01:00.232 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-17T23:01:00.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs2 2024-09-17T23:01:00.858 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2/2 2024-09-17T23:01:00.858 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/2 2024-09-17T23:01:00.979 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:37 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:01.072 INFO:teuthology.orchestra.run.smithi152.stdout:Package libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:01.116 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:01.117 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:01:01.118 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:01.123 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-17T23:01:01.123 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:01.123 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:01:01.123 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-17T23:01:01.123 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:01.123 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:01.183 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install libcephfs-devel 2024-09-17T23:01:01.394 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install ceph-volume 2024-09-17T23:01:01.776 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:01.909 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 32 k 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-17T23:01:01.910 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:01.911 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 32 k 2024-09-17T23:01:01.911 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 142 k 2024-09-17T23:01:01.911 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:01:02.016 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:38 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:02.072 INFO:teuthology.orchestra.run.smithi152.stdout:libcephfs-devel-19.1.1-330.gc2ddf972.el9.x86_64 197 kB/s | 32 kB 00:00 2024-09-17T23:01:02.073 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:02.073 INFO:teuthology.orchestra.run.smithi152.stdout:Total 195 kB/s | 32 kB 00:00 2024-09-17T23:01:02.073 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:01:02.077 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:01:02.077 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:01:02.094 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:01:02.094 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:01:02.155 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repository Size 2024-09-17T23:01:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:01:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume noarch 2:19.1.1-330.gc2ddf972.el9 ceph-noarch 285 k 2024-09-17T23:01:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:01:02.156 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:02.157 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-17T23:01:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:02.157 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 285 k 2024-09-17T23:01:02.157 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 1.3 M 2024-09-17T23:01:02.157 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:01:02.189 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:01:02.311 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:02.367 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-volume-19.1.1-330.gc2ddf972.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-17T23:01:02.369 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:02.369 INFO:teuthology.orchestra.run.smithi005.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-17T23:01:02.369 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:01:02.378 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:01:02.378 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:01:02.404 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:01:02.404 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:01:02.635 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:01:02.703 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:01:02.717 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:02.720 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:01:02.720 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:01:02.720 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T23:01:02.720 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:02.962 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:02.962 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:02.963 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:01:02.963 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:02.963 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:02.963 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:03.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librados2 2024-09-17T23:01:03.732 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:40 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:03.738 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 1/1 2024-09-17T23:01:03.738 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:03.738 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:01:03.738 INFO:teuthology.orchestra.run.smithi005.stdout: ceph-volume-2:19.1.1-330.gc2ddf972.el9.noarch 2024-09-17T23:01:03.738 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:03.738 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:03.822 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:03.865 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:03.866 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:01:03.866 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:03.931 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install librbd1 2024-09-17T23:01:04.044 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados-devel 2024-09-17T23:01:04.512 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:41 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:04.603 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:04.647 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:01:04.648 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:04.661 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:40 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:04.715 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rados 2024-09-17T23:01:04.800 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:04.801 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:04.801 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-09-17T23:01:04.801 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:04.801 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:01:04.801 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 127 k 2024-09-17T23:01:04.801 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:04.801 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:01:04.802 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:04.802 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-17T23:01:04.802 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:04.802 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 127 k 2024-09-17T23:01:04.802 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 456 k 2024-09-17T23:01:04.802 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:01:05.006 INFO:teuthology.orchestra.run.smithi005.stdout:librados-devel-19.1.1-330.gc2ddf972.el9.x86_64. 620 kB/s | 127 kB 00:00 2024-09-17T23:01:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:Total 616 kB/s | 127 kB 00:00 2024-09-17T23:01:05.007 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:01:05.013 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:01:05.013 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:01:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:01:05.080 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:01:05.233 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:01:05.301 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:05.324 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:05.391 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:05.434 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:05.435 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:01:05.436 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:05.518 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rgw 2024-09-17T23:01:05.761 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:06.007 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:06.007 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:06.007 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:01:06.007 INFO:teuthology.orchestra.run.smithi005.stdout: librados-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:06.007 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:06.008 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:06.101 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:06.191 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:06.234 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:06.235 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:01:06.235 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:06.277 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs2 2024-09-17T23:01:06.297 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-cephfs 2024-09-17T23:01:06.880 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:06.891 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:42 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:06.968 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:06.984 INFO:teuthology.orchestra.run.smithi005.stdout:Package libcephfs2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:07.011 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:07.012 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:01:07.012 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:07.029 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:07.030 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:01:07.031 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:07.073 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install python3-rbd 2024-09-17T23:01:07.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install libcephfs-devel 2024-09-17T23:01:07.660 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:44 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:07.714 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:43 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:07.748 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:07.791 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:07.792 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2024-09-17T23:01:07.792 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:07.853 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 32 k 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 32 k 2024-09-17T23:01:07.854 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 142 k 2024-09-17T23:01:07.855 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:01:07.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-fuse 2024-09-17T23:01:08.002 INFO:teuthology.orchestra.run.smithi005.stdout:libcephfs-devel-19.1.1-330.gc2ddf972.el9.x86_64 215 kB/s | 32 kB 00:00 2024-09-17T23:01:08.003 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:08.003 INFO:teuthology.orchestra.run.smithi005.stdout:Total 213 kB/s | 32 kB 00:00 2024-09-17T23:01:08.003 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:01:08.007 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:01:08.007 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:01:08.022 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:01:08.023 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:01:08.111 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:01:08.228 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:08.463 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:08.588 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:08.604 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:08.605 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:08.605 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-17T23:01:08.605 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:08.605 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:01:08.605 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 85 k 2024-09-17T23:01:08.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:08.606 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:01:08.606 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:08.606 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-17T23:01:08.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:08.606 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 85 k 2024-09-17T23:01:08.606 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 231 k 2024-09-17T23:01:08.606 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:01:08.792 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-fuse-19.1.1-330.gc2ddf972.el9.x86_64.rpm 460 kB/s | 85 kB 00:00 2024-09-17T23:01:08.792 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:08.793 INFO:teuthology.orchestra.run.smithi152.stdout:Total 456 kB/s | 85 kB 00:00 2024-09-17T23:01:08.794 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:01:08.801 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:01:08.801 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:01:08.820 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:08.821 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:01:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: libcephfs-devel-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:08.821 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:08.821 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:08.864 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:01:08.865 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:01:09.018 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:01:09.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librados2 2024-09-17T23:01:09.114 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:09.546 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:09.627 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:45 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:09.718 INFO:teuthology.orchestra.run.smithi005.stdout:Package librados2-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:09.765 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:09.766 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:01:09.766 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:09.795 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:01:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:09.795 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:09.844 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install librbd1 2024-09-17T23:01:10.121 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-mirror 2024-09-17T23:01:10.443 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:46 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:10.536 INFO:teuthology.orchestra.run.smithi005.stdout:Package librbd1-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:10.581 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:10.582 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:01:10.582 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:10.671 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rados 2024-09-17T23:01:10.721 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:10.857 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repo Size 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.1 M 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 3.1 M 2024-09-17T23:01:10.858 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 13 M 2024-09-17T23:01:10.859 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:01:11.186 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-mirror-19.1.1-330.gc2ddf972.el9.x86_64.rpm 9.5 MB/s | 3.1 MB 00:00 2024-09-17T23:01:11.187 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:11.187 INFO:teuthology.orchestra.run.smithi152.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-17T23:01:11.187 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:01:11.196 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:01:11.197 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:01:11.278 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:47 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:11.279 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:01:11.279 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:01:11.371 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rados-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:11.416 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:11.417 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:01:11.417 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:11.515 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rgw 2024-09-17T23:01:11.718 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:01:11.787 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:11.813 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:11.813 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:01:11.813 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T23:01:11.813 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T23:01:11.813 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T23:01:11.813 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:12.130 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:12.222 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rgw-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:12.268 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:12.269 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:01:12.269 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:12.361 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-cephfs 2024-09-17T23:01:12.902 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:12.902 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:12.902 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:01:12.902 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:12.902 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:12.902 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:12.968 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:48 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:13.060 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-cephfs-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:13.107 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:13.108 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:01:13.108 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:13.154 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install rbd-nbd 2024-09-17T23:01:13.198 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install python3-rbd 2024-09-17T23:01:13.743 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:01:50 ago on Tue 17 Sep 2024 10:59:23 PM UTC. 2024-09-17T23:01:13.813 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:49 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:13.879 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-09-17T23:01:13.879 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 170 k 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout:Install 1 Package 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 170 k 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 494 k 2024-09-17T23:01:13.880 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-09-17T23:01:13.907 INFO:teuthology.orchestra.run.smithi005.stdout:Package python3-rbd-2:19.1.1-330.gc2ddf972.el9.x86_64 is already installed. 2024-09-17T23:01:13.953 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:13.954 INFO:teuthology.orchestra.run.smithi005.stdout:Nothing to do. 2024-09-17T23:01:13.954 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:14.037 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-fuse 2024-09-17T23:01:14.089 INFO:teuthology.orchestra.run.smithi152.stdout:rbd-nbd-19.1.1-330.gc2ddf972.el9.x86_64.rpm 819 kB/s | 170 kB 00:00 2024-09-17T23:01:14.089 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:14.090 INFO:teuthology.orchestra.run.smithi152.stdout:Total 813 kB/s | 170 kB 00:00 2024-09-17T23:01:14.090 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-09-17T23:01:14.097 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-09-17T23:01:14.097 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-09-17T23:01:14.161 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-09-17T23:01:14.161 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-09-17T23:01:14.325 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-09-17T23:01:14.437 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:14.649 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:50 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:14.790 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:14.791 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:14.791 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-17T23:01:14.791 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:14.791 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:01:14.791 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 85 k 2024-09-17T23:01:14.791 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:14.791 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:01:14.792 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:14.792 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-17T23:01:14.792 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:14.792 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 85 k 2024-09-17T23:01:14.792 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 231 k 2024-09-17T23:01:14.792 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:01:14.863 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:14.973 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-fuse-19.1.1-330.gc2ddf972.el9.x86_64.rpm 473 kB/s | 85 kB 00:00 2024-09-17T23:01:14.974 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:14.974 INFO:teuthology.orchestra.run.smithi005.stdout:Total 467 kB/s | 85 kB 00:00 2024-09-17T23:01:14.975 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:01:14.989 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:01:14.989 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:01:15.063 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:01:15.063 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:01:15.138 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:15.138 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:15.138 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-09-17T23:01:15.138 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:15.138 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:15.138 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-09-17T23:01:15.221 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:01:15.332 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:15.428 DEBUG:teuthology.parallel:result is None 2024-09-17T23:01:15.735 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:15.995 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:01:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-fuse-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:15.995 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:15.995 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:16.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-mirror 2024-09-17T23:01:16.887 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:52 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:17.028 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:17.029 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-09-17T23:01:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:17.029 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 3.1 M 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 3.1 M 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 13 M 2024-09-17T23:01:17.030 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:01:17.351 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-mirror-19.1.1-330.gc2ddf972.el9.x86_64.rpm 9.7 MB/s | 3.1 MB 00:00 2024-09-17T23:01:17.352 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:17.352 INFO:teuthology.orchestra.run.smithi005.stdout:Total 9.6 MB/s | 3.1 MB 00:00 2024-09-17T23:01:17.353 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:01:17.362 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:01:17.362 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:01:17.450 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:01:17.451 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:01:17.906 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:01:17.969 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:17.996 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:17.996 INFO:teuthology.orchestra.run.smithi005.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T23:01:17.996 INFO:teuthology.orchestra.run.smithi005.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T23:01:17.996 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T23:01:17.996 INFO:teuthology.orchestra.run.smithi005.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T23:01:17.996 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:19.104 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:19.105 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:01:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-mirror-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:19.105 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:19.105 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:19.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum -y install rbd-nbd 2024-09-17T23:01:19.961 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:55 ago on Tue 17 Sep 2024 10:59:24 PM UTC. 2024-09-17T23:01:20.100 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-09-17T23:01:20.101 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-09-17T23:01:20.101 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:20.101 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-09-17T23:01:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd x86_64 2:19.1.1-330.gc2ddf972.el9 ceph 170 k 2024-09-17T23:01:20.101 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:20.101 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-09-17T23:01:20.102 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-09-17T23:01:20.102 INFO:teuthology.orchestra.run.smithi005.stdout:Install 1 Package 2024-09-17T23:01:20.102 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:20.102 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 170 k 2024-09-17T23:01:20.102 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 494 k 2024-09-17T23:01:20.102 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-09-17T23:01:20.314 INFO:teuthology.orchestra.run.smithi005.stdout:rbd-nbd-19.1.1-330.gc2ddf972.el9.x86_64.rpm 806 kB/s | 170 kB 00:00 2024-09-17T23:01:20.314 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-09-17T23:01:20.314 INFO:teuthology.orchestra.run.smithi005.stdout:Total 800 kB/s | 170 kB 00:00 2024-09-17T23:01:20.315 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-09-17T23:01:20.323 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-09-17T23:01:20.324 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-09-17T23:01:20.391 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-09-17T23:01:20.391 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-09-17T23:01:20.553 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-09-17T23:01:20.664 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:21.092 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 1/1 2024-09-17T23:01:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:21.345 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-09-17T23:01:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: rbd-nbd-2:19.1.1-330.gc2ddf972.el9.x86_64 2024-09-17T23:01:21.345 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:21.345 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-09-17T23:01:21.579 DEBUG:teuthology.parallel:result is None 2024-09-17T23:01:21.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T23:01:21.726 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T23:01:21.748 INFO:teuthology.orchestra.run.smithi005.stdout:19.1.1-330.gc2ddf972.el9 2024-09-17T23:01:21.749 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330.gc2ddf972.el9 2024-09-17T23:01:21.749 INFO:teuthology.task.install:The correct ceph version 19.1.1-330.gc2ddf972 is installed. 2024-09-17T23:01:21.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c2ddf9721ef254645201cdbabd9c8f49c30a586f 2024-09-17T23:01:21.888 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T23:01:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:19.1.1-330.gc2ddf972.el9 2024-09-17T23:01:21.914 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-330.gc2ddf972.el9 2024-09-17T23:01:21.915 INFO:teuthology.task.install:The correct ceph version 19.1.1-330.gc2ddf972 is installed. 2024-09-17T23:01:21.916 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T23:01:21.917 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:21.917 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T23:01:21.945 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:21.945 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T23:01:21.984 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T23:01:21.985 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:21.985 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T23:01:22.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T23:01:22.078 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:22.078 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T23:01:22.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T23:01:22.173 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T23:01:22.173 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:22.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T23:01:22.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T23:01:22.265 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:22.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T23:01:22.292 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T23:01:22.358 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T23:01:22.359 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:22.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T23:01:22.385 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T23:01:22.451 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:22.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T23:01:22.477 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T23:01:22.543 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T23:01:22.623 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T23:01:22.623 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /var/log/ceph 2024-09-17T23:01:22.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2024-09-17T23:01:22.650 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T23:01:22.650 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T23:01:22.692 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T23:01:22.716 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T23:01:22.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T23:01:22.758 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T23:01:22.792 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T23:01:22.792 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T23:01:22.792 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/journal}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7909565', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1983, 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f', 'sleep_before_teardown': 0, 'subset': '79/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b0d356b98e08f6bc59ef15652f0d0e4298fc83c7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7', 'targets': {'smithi005.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO7nS0AcqtttGJsv73Qr/WrNX2I0l1wxwVEZaLTc1zTG7MYVFth5iia3NRdE8vR0luuiAcIHOVIKZivAJo2gWns=', 'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBH3YuhgHeaR9fCOJnytSc76s3fqiEqFJyaURKg9KTAMWKfjS+aGLztVJa/lhcBqAkitg7rboKLGnlKir2sxiUc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rbd/journal.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_21:16:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T23:01:22.793 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T23:01:22.824 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T23:01:22.839 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T23:01:22.880 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T23:01:22.904 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:22.904 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T23:01:22.959 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T23:01:22.960 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-09-17T23:01:23.015 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T23:01:23.015 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T23:01:23.015 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T23:01:23.015 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T23:01:23.015 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T23:01:23.016 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-17 23:01:18.254639164 +0000 2024-09-17T23:01:23.016 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-17 22:58:43.180397047 +0000 2024-09-17T23:01:23.016 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-17 22:58:43.180397047 +0000 2024-09-17T23:01:23.016 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-17 22:58:43.180397047 +0000 2024-09-17T23:01:23.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T23:01:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-17T23:01:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-17T23:01:23.079 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000106468 s, 4.8 MB/s 2024-09-17T23:01:23.080 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T23:01:23.137 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-09-17T23:01:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T23:01:23.193 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T23:01:23.193 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-17T23:01:23.193 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T23:01:23.194 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T23:01:23.194 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-17 23:01:18.254639164 +0000 2024-09-17T23:01:23.194 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-17 22:58:43.501390512 +0000 2024-09-17T23:01:23.194 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-17 22:58:43.501390512 +0000 2024-09-17T23:01:23.194 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-17 22:58:43.501390512 +0000 2024-09-17T23:01:23.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T23:01:23.256 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-17T23:01:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-17T23:01:23.257 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000101046 s, 5.1 MB/s 2024-09-17T23:01:23.258 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T23:01:23.315 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-09-17T23:01:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T23:01:23.371 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T23:01:23.371 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-17T23:01:23.371 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T23:01:23.371 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T23:01:23.371 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-17 23:01:18.255639144 +0000 2024-09-17T23:01:23.371 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-17 22:58:43.825383915 +0000 2024-09-17T23:01:23.372 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-17 22:58:43.825383915 +0000 2024-09-17T23:01:23.372 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-17 22:58:43.825383915 +0000 2024-09-17T23:01:23.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T23:01:23.434 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-17T23:01:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-17T23:01:23.435 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.00010143 s, 5.0 MB/s 2024-09-17T23:01:23.436 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T23:01:23.492 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-09-17T23:01:23.547 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T23:01:23.548 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T23:01:23.548 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-17T23:01:23.548 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T23:01:23.548 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T23:01:23.548 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-09-17 23:01:18.255639144 +0000 2024-09-17T23:01:23.548 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-09-17 22:58:44.155377196 +0000 2024-09-17T23:01:23.548 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-09-17 22:58:44.155377196 +0000 2024-09-17T23:01:23.548 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: 2024-09-17 22:58:44.155377196 +0000 2024-09-17T23:01:23.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T23:01:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-09-17T23:01:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-09-17T23:01:23.611 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 8.6919e-05 s, 5.9 MB/s 2024-09-17T23:01:23.612 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T23:01:23.669 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:23.669 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:23.669 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T23:01:23.686 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T23:01:23.686 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-17 23:01:12.060399642 +0000 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-17 22:58:40.692113888 +0000 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-17 22:58:40.692113888 +0000 2024-09-17T23:01:23.743 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-17 22:58:40.692113888 +0000 2024-09-17T23:01:23.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T23:01:23.808 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-17T23:01:23.808 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-17T23:01:23.808 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000264123 s, 1.9 MB/s 2024-09-17T23:01:23.810 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T23:01:23.867 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-09-17T23:01:23.923 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T23:01:23.923 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T23:01:23.923 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-17T23:01:23.923 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T23:01:23.923 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T23:01:23.923 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-17 23:01:12.060399642 +0000 2024-09-17T23:01:23.923 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-17 22:58:41.019110298 +0000 2024-09-17T23:01:23.924 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-17 22:58:41.019110298 +0000 2024-09-17T23:01:23.924 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-17 22:58:41.019110298 +0000 2024-09-17T23:01:23.924 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T23:01:23.987 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-17T23:01:23.987 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-17T23:01:23.987 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000243826 s, 2.1 MB/s 2024-09-17T23:01:23.988 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T23:01:24.044 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-09-17T23:01:24.099 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T23:01:24.100 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T23:01:24.100 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-17T23:01:24.100 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T23:01:24.100 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T23:01:24.100 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-17 23:01:12.060399642 +0000 2024-09-17T23:01:24.100 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-17 22:58:41.356106598 +0000 2024-09-17T23:01:24.100 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-17 22:58:41.356106598 +0000 2024-09-17T23:01:24.100 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-17 22:58:41.356106598 +0000 2024-09-17T23:01:24.100 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T23:01:24.163 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-17T23:01:24.163 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-17T23:01:24.163 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000211532 s, 2.4 MB/s 2024-09-17T23:01:24.164 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T23:01:24.220 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-09-17T23:01:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T23:01:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T23:01:24.275 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T23:01:24.275 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T23:01:24.275 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T23:01:24.276 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-09-17 23:01:12.061399631 +0000 2024-09-17T23:01:24.276 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-09-17 22:58:41.682103020 +0000 2024-09-17T23:01:24.276 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-09-17 22:58:41.682103020 +0000 2024-09-17T23:01:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-09-17 22:58:41.682103020 +0000 2024-09-17T23:01:24.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T23:01:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-09-17T23:01:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-09-17T23:01:24.338 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000195489 s, 2.6 MB/s 2024-09-17T23:01:24.339 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T23:01:24.395 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:24.395 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T23:01:24.396 INFO:tasks.ceph:Generating config... 2024-09-17T23:01:24.397 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-17T23:01:24.397 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-17T23:01:24.397 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-17T23:01:24.397 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T23:01:24.397 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T23:01:24.397 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T23:01:24.398 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T23:01:24.398 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T23:01:24.398 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T23:01:24.399 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-17T23:01:24.400 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T23:01:24.400 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T23:01:24.454 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T23:01:24.457 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T23:01:24.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T23:01:24.528 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.5'), ('mon.c', '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]'), ('mon.b', '172.21.15.152')] 2024-09-17T23:01:24.529 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],172.21.15.152', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-17T23:01:24.530 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:24.530 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T23:01:24.585 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.5 --addv c '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]' --add b 172.21.15.152 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:24.673 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: generated fsid 4cb0491c-5273-43ce-9711-0f68bec58f2e 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:setting min_mon_release = quincy 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 0 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 4cb0491c-5273-43ce-9711-0f68bec58f2e 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:last_changed 2024-09-17T23:01:24.672096+0000 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-09-17T23:01:24.672096+0000 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:min_mon_release 17 (quincy) 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:election_strategy: 1 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:1: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.b 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:2: [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon.c 2024-09-17T23:01:24.674 INFO:teuthology.orchestra.run.smithi005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T23:01:24.675 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T23:01:24.691 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4cb0491c-5273-43ce-9711-0f68bec58f2e... 2024-09-17T23:01:24.692 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T23:01:24.734 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T23:01:24.776 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-09-17T23:01:24.776 INFO:teuthology.orchestra.run.smithi005.stdout: chdir = "" 2024-09-17T23:01:24.776 INFO:teuthology.orchestra.run.smithi005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T23:01:24.777 INFO:teuthology.orchestra.run.smithi005.stdout: auth supported = cephx 2024-09-17T23:01:24.777 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: filestore xattr use omap = true 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: mon clock drift allowed = 1.000 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: osd crush chooseleaf type = 0 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: auth debug = true 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on old message = true 2024-09-17T23:01:24.780 INFO:teuthology.orchestra.run.smithi005.stdout: ms die on bug = true 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: mon pg warn max object skew = 0 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default size = 2 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow primary affinity = true 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd allow pg remap = true 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on legacy crush tunables = false 2024-09-17T23:01:24.781 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on crush straw calc version zero = false 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on no sortbitwise = false 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on osd down out interval zero = false 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on too few osds = false 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: mon_allow_pool_size_one = true 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: osd default data pool replay window = 5 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: mon allow pool delete = true 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.782 INFO:teuthology.orchestra.run.smithi005.stdout: mon cluster log file level = debug 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: debug asserts on shutdown = true 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: mon health detail to clog = false 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],172.21.15.152" 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: mon client directed command retry = 5 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: mon warn on pool no app = False 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: ms inject socket failures = 5000 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 4cb0491c-5273-43ce-9711-0f68bec58f2e 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout:[osd] 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: osd journal size = 100 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub load threshold = 5.0 2024-09-17T23:01:24.783 INFO:teuthology.orchestra.run.smithi005.stdout: osd scrub max interval = 600 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd mclock profile = high_recovery_ops 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd recover clone overlap = true 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd recovery max chunk = 1048576 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug shutdown = true 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug op order = true 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug verify stray on activate = true 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug trim objects = true 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd open classes on start = true 2024-09-17T23:01:24.784 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug pg log writeout = true 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: osd deep scrub update digest min age = 30 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: osd map max advance = 10 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: journal zero on create = true 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: filestore ondisk finisher threads = 3 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: filestore apply finisher threads = 3 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: bdev debug aio = true 2024-09-17T23:01:24.785 INFO:teuthology.orchestra.run.smithi005.stdout: osd debug misdirected ops = true 2024-09-17T23:01:24.786 INFO:teuthology.orchestra.run.smithi005.stdout: bdev async discard = True 2024-09-17T23:01:24.786 INFO:teuthology.orchestra.run.smithi005.stdout: bdev enable discard = True 2024-09-17T23:01:24.786 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore block size = 96636764160 2024-09-17T23:01:24.786 INFO:teuthology.orchestra.run.smithi005.stdout: bluestore fsck on mount = True 2024-09-17T23:01:24.786 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluefs = 1/20 2024-09-17T23:01:24.786 INFO:teuthology.orchestra.run.smithi005.stdout: debug bluestore = 1/20 2024-09-17T23:01:24.786 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-17T23:01:24.786 INFO:teuthology.orchestra.run.smithi005.stdout: debug osd = 20 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: debug rocksdb = 4/10 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd full ratio = 0.9 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd nearfull ratio = 0.8 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: osd blocked scrub grace period = 3600 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: osd failsafe full ratio = 0.95 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: osd max markdown count = 1000 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: osd memory target = 1610612736 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: osd objectstore = bluestore 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: osd shutdown pgref assert = True 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.787 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr] 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: debug mgr = 20 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: mgr/telemetry/nag = false 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout:[mon] 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: debug ms = 1 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: debug mon = 20 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: debug paxos = 20 2024-09-17T23:01:24.788 INFO:teuthology.orchestra.run.smithi005.stdout: debug auth = 20 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: mon data avail warn = 5 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: mon mgr mkfs grace = 240 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min pgs per osd = 4 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd reporter subtree level = osd 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: mon osd prime pg temp = true 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: mon reweight min bytes per osd = 10 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T23:01:24.789 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: # 1m isn't quite enough 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: mon_down_mkfs_grace = 2m 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: mon_warn_on_filestore_osds = false 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout:[client] 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: rgw cache enabled = true 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable ops log = true 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: rgw enable usage log = true 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T23:01:24.790 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.a] 2024-09-17T23:01:24.791 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.c] 2024-09-17T23:01:24.791 INFO:teuthology.orchestra.run.smithi005.stdout:[mon.b] 2024-09-17T23:01:24.792 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2024-09-17T23:01:24.792 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2024-09-17T23:01:24.792 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T23:01:24.792 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2024-09-17T23:01:24.792 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.792 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T23:01:24.793 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2024-09-17T23:01:24.794 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],172.21.15.152" 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: mon client directed command retry = 5 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on pool no app = False 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: ms inject socket failures = 5000 2024-09-17T23:01:24.795 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 4cb0491c-5273-43ce-9711-0f68bec58f2e 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd mclock profile = high_recovery_ops 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2024-09-17T23:01:24.796 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug trim objects = true 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2024-09-17T23:01:24.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: bdev async discard = True 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: bdev enable discard = True 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 1/20 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 1/20 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 4/10 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2024-09-17T23:01:24.798 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: osd blocked scrub grace period = 3600 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: osd max markdown count = 1000 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: osd memory target = 1610612736 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: osd shutdown pgref assert = True 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-09-17T23:01:24.799 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.800 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2024-09-17T23:01:24.801 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2024-09-17T23:01:24.802 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2024-09-17T23:01:24.802 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2024-09-17T23:01:24.802 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T23:01:24.802 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T23:01:24.802 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2024-09-17T23:01:24.802 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2024-09-17T23:01:24.802 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2024-09-17T23:01:24.802 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T23:01:24.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T23:01:24.888 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T23:01:24.888 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:24.888 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T23:01:24.904 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:24.904 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T23:01:24.960 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:01:24.960 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:24.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T23:01:24.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T23:01:25.036 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:25.036 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:25.092 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:01:25.092 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:25.092 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T23:01:25.092 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T23:01:25.128 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:25.128 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:25.183 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T23:01:25.183 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T23:01:25.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T23:01:25.236 INFO:teuthology.orchestra.run.smithi005.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T23:01:25.238 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T23:01:25.298 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T23:01:25.301 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T23:01:25.301 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T23:01:25.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T23:01:25.343 INFO:teuthology.orchestra.run.smithi005.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T23:01:25.357 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T23:01:25.398 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T23:01:25.411 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T23:01:25.411 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi005.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T23:01:25.411 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T23:01:25.436 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:25.437 INFO:tasks.ceph:role: osd.0 2024-09-17T23:01:25.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:01:25.437 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T23:01:25.502 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T23:01:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T23:01:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T23:01:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T23:01:25.502 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T23:01:25.502 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-17T23:01:25.502 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T23:01:25.503 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T23:01:25.503 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T23:01:25.503 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T23:01:25.535 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-17T23:01:25.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-17T23:01:25.537 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T23:01:25.606 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T23:01:25.676 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T23:01:25.742 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:25.742 INFO:tasks.ceph:role: osd.1 2024-09-17T23:01:25.742 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:01:25.742 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T23:01:25.807 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T23:01:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T23:01:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T23:01:25.807 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T23:01:25.808 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T23:01:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-17T23:01:25.808 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T23:01:25.808 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T23:01:25.808 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T23:01:25.808 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T23:01:25.840 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-17T23:01:25.842 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-17T23:01:25.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T23:01:25.912 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T23:01:25.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T23:01:26.048 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:26.048 INFO:tasks.ceph:role: osd.2 2024-09-17T23:01:26.048 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:01:26.049 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T23:01:26.114 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T23:01:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T23:01:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T23:01:26.114 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T23:01:26.115 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T23:01:26.115 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-17T23:01:26.115 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T23:01:26.115 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T23:01:26.115 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T23:01:26.115 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T23:01:26.146 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-17T23:01:26.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-17T23:01:26.149 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T23:01:26.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T23:01:26.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T23:01:26.369 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:26.370 INFO:tasks.ceph:role: osd.3 2024-09-17T23:01:26.370 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:01:26.370 DEBUG:teuthology.orchestra.run.smithi005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: = sunit=0 swidth=0 blks 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T23:01:26.437 INFO:teuthology.orchestra.run.smithi005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T23:01:26.469 INFO:teuthology.orchestra.run.smithi005.stdout:Discarding blocks...Done. 2024-09-17T23:01:26.471 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi005.front.sepia.ceph.com -o noatime 2024-09-17T23:01:26.471 DEBUG:teuthology.orchestra.run.smithi005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T23:01:26.540 DEBUG:teuthology.orchestra.run.smithi005:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T23:01:26.613 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:26.705 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:26.703+0000 7fa8f420d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T23:01:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:26.703+0000 7fa8f420d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T23:01:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:26.703+0000 7fa8f420d640 -1 bdev(0x55f55d0b9800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T23:01:26.706 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:26.703+0000 7fa8f420d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T23:01:30.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T23:01:30.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:30.233+0000 7fb8da618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T23:01:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:30.233+0000 7fb8da618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T23:01:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:30.233+0000 7fb8da618640 -1 bdev(0x5559ec00b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T23:01:30.236 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:30.234+0000 7fb8da618640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T23:01:33.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T23:01:33.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:33.511 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:33.509+0000 7f370ee0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T23:01:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:33.509+0000 7f370ee0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T23:01:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:33.509+0000 7f370ee0c640 -1 bdev(0x56098b121800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T23:01:33.512 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:33.509+0000 7f370ee0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T23:01:36.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T23:01:36.458 DEBUG:teuthology.orchestra.run.smithi005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:36.552 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:36.550+0000 7fb11b211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T23:01:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:36.550+0000 7fb11b211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T23:01:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:36.550+0000 7fb11b211640 -1 bdev(0x564cb2bb9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T23:01:36.553 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:01:36.550+0000 7fb11b211640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T23:01:39.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T23:01:39.985 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T23:01:40.016 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:40.016 INFO:tasks.ceph:role: osd.4 2024-09-17T23:01:40.016 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:01:40.016 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T23:01:40.092 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T23:01:40.092 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T23:01:40.092 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T23:01:40.092 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T23:01:40.092 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T23:01:40.092 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-09-17T23:01:40.093 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T23:01:40.093 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T23:01:40.093 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T23:01:40.093 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T23:01:40.592 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-09-17T23:01:40.595 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-09-17T23:01:40.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T23:01:40.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T23:01:40.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T23:01:40.797 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:40.797 INFO:tasks.ceph:role: osd.5 2024-09-17T23:01:40.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:01:40.797 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T23:01:40.870 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T23:01:40.870 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T23:01:40.870 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T23:01:40.870 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T23:01:40.870 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T23:01:40.871 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-09-17T23:01:40.871 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T23:01:40.871 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T23:01:40.871 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T23:01:40.871 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T23:01:41.331 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-09-17T23:01:41.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-09-17T23:01:41.334 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T23:01:41.407 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T23:01:41.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T23:01:41.541 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:41.541 INFO:tasks.ceph:role: osd.6 2024-09-17T23:01:41.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:01:41.542 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T23:01:41.613 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T23:01:41.613 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T23:01:41.613 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T23:01:41.613 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T23:01:41.613 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T23:01:41.613 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-09-17T23:01:41.613 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T23:01:41.613 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T23:01:41.614 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T23:01:41.614 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T23:01:42.104 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-09-17T23:01:42.106 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-09-17T23:01:42.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T23:01:42.199 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T23:01:42.228 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T23:01:42.293 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T23:01:42.294 INFO:tasks.ceph:role: osd.7 2024-09-17T23:01:42.294 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:01:42.294 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T23:01:42.366 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T23:01:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T23:01:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T23:01:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T23:01:42.366 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T23:01:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-09-17T23:01:42.367 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T23:01:42.367 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T23:01:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T23:01:42.367 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T23:01:42.865 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-09-17T23:01:42.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-09-17T23:01:42.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T23:01:43.021 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T23:01:43.054 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:43.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:43.154+0000 7f110d624640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T23:01:43.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:43.157+0000 7f110d624640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T23:01:43.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:43.157+0000 7f110d624640 -1 bdev(0x55cda55bb800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T23:01:43.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:43.157+0000 7f110d624640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T23:01:47.058 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T23:01:47.088 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:47.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:47.175+0000 7f3f8fe33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T23:01:47.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:47.175+0000 7f3f8fe33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T23:01:47.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:47.175+0000 7f3f8fe33640 -1 bdev(0x5638c1937800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T23:01:47.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:47.175+0000 7f3f8fe33640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T23:01:50.579 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T23:01:50.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:50.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:50.695+0000 7fe82e5b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T23:01:50.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:50.695+0000 7fe82e5b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T23:01:50.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:50.696+0000 7fe82e5b2640 -1 bdev(0x564aff127800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T23:01:50.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:50.696+0000 7fe82e5b2640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T23:01:54.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T23:01:54.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:01:54.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:54.713+0000 7f1bf5c20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T23:01:54.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:54.713+0000 7f1bf5c20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T23:01:54.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:54.713+0000 7f1bf5c20640 -1 bdev(0x55d62929b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T23:01:54.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-09-17T23:01:54.713+0000 7f1bf5c20640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T23:01:58.117 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T23:01:58.147 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T23:01:58.147 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:58.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T23:01:58.179 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:58.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T23:01:58.249 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:58.249 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T23:01:58.318 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:58.319 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T23:01:58.387 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:58.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T23:01:58.456 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:58.456 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T23:01:58.486 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:58.486 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T23:01:58.554 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:58.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T23:01:58.622 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:58.622 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T23:01:58.689 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:58.689 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T23:01:58.755 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:01:58.755 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T23:01:58.774 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:01:58.774 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T23:01:58.812 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T23:01:58.812 DEBUG:teuthology.orchestra.run.smithi005:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T23:01:58.816 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.y] 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBFCupmjY37DRAAbzLxA9iCmuInEnw4YflG1g== 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.0] 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBGCupmRtL0KRAAQ4zdOb5i796B90V1Zv9Wpg== 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.1] 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBKCupm6U37DRAAVU8xsVTLQhWkJbYxZde04g== 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.2] 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBNCupmFkhmHhAAxaGPyooMd29Lp3iuPyt7uA== 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.3] 2024-09-17T23:01:58.856 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBQCupmQ0DXIBAAJ6Qq8pVDCFt+Q9i9MFCtfQ== 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout:[mgr.x] 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBFCupmoS60ERAAxipGFxu2PqDA8HLCGiFr4A== 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.4] 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBXCupm8elHCRAAsmj4xAHgpXoGby/VcF2ZLg== 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.5] 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBbCupm0+mCChAAXNw0KTvpxIAWdpCYFwglwg== 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.6] 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBeCupmLhaTKRAAFK628Pt3ha+OzvRG7vgr6Q== 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout:[osd.7] 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBiCupmYn6gKhAAZxR2rghAYQ79OPmQfsQ3nw== 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-09-17T23:01:58.857 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBFCupmCmVpFBAAni5fmfXJahb9TrvKCPunAQ== 2024-09-17T23:01:58.858 INFO:teuthology.orchestra.run.smithi005.stdout:[client.1] 2024-09-17T23:01:58.858 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQBFCupmntGoFxAAiZ+wKIDkGjaab2CynS3GRQ== 2024-09-17T23:01:58.876 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBFCupmjY37DRAAbzLxA9iCmuInEnw4YflG1g== 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBGCupmRtL0KRAAQ4zdOb5i796B90V1Zv9Wpg== 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBKCupm6U37DRAAVU8xsVTLQhWkJbYxZde04g== 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBNCupmFkhmHhAAxaGPyooMd29Lp3iuPyt7uA== 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBQCupmQ0DXIBAAJ6Qq8pVDCFt+Q9i9MFCtfQ== 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBFCupmoS60ERAAxipGFxu2PqDA8HLCGiFr4A== 2024-09-17T23:01:58.877 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBXCupm8elHCRAAsmj4xAHgpXoGby/VcF2ZLg== 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBbCupm0+mCChAAXNw0KTvpxIAWdpCYFwglwg== 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBeCupmLhaTKRAAFK628Pt3ha+OzvRG7vgr6Q== 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBiCupmYn6gKhAAZxR2rghAYQ79OPmQfsQ3nw== 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBFCupmCmVpFBAAni5fmfXJahb9TrvKCPunAQ== 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2024-09-17T23:01:58.878 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBFCupmntGoFxAAiZ+wKIDkGjaab2CynS3GRQ== 2024-09-17T23:01:58.879 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T23:01:58.902 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T23:01:58.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:58.973 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.029 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.082 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.133 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.135 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.186 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T23:01:59.188 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T23:01:59.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.241 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.294 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.346 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.397 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.400 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T23:01:59.452 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T23:01:59.454 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T23:01:59.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T23:01:59.511 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T23:01:59.566 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T23:01:59.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T23:01:59.593 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T23:01:59.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T23:01:59.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T23:01:59.783 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T23:01:59.880 DEBUG:teuthology.orchestra.run.smithi005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T23:01:59.906 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T23:01:59.932 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T23:02:00.029 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T23:02:00.054 DEBUG:teuthology.orchestra.run.smithi005:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:02:00.057 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T23:02:00.110 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T23:02:00.110 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T23:02:00.110 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T23:02:00.113 INFO:tasks.ceph.mon.a:Started 2024-09-17T23:02:00.113 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T23:02:00.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T23:02:00.115 INFO:tasks.ceph.mon.c:Started 2024-09-17T23:02:00.115 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T23:02:00.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T23:02:00.153 INFO:tasks.ceph.mon.b:Started 2024-09-17T23:02:00.153 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T23:02:00.153 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T23:02:00.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T23:02:00.156 INFO:tasks.ceph.mgr.y:Started 2024-09-17T23:02:00.156 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T23:02:00.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T23:02:00.159 INFO:tasks.ceph.mgr.x:Started 2024-09-17T23:02:00.159 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T23:02:00.159 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T23:02:05.548 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:05.545+0000 7f53b6799040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T23:02:05.559 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:05.557+0000 7f0ab0a14040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-17T23:02:05.589 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:05.587+0000 7f53b6799040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T23:02:05.603 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:05.601+0000 7f0ab0a14040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-17T23:02:05.732 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:05.729+0000 7f53b6799040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T23:02:05.755 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:05.752+0000 7f0ab0a14040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-17T23:02:05.781 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:05.778+0000 7f53b6799040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T23:02:05.808 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:05.805+0000 7f0ab0a14040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-17T23:02:05.947 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:05.944+0000 7f53b6799040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T23:02:05.976 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:05.973+0000 7f0ab0a14040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-17T23:02:06.056 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:06.054+0000 7f53b6799040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T23:02:06.091 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:06.089+0000 7f0ab0a14040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-17T23:02:06.341 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-09-17T23:02:06.352 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T23:02:06.353 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T23:02:06.353 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:02:06.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T23:02:06.374 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:06.372+0000 7f53b6799040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T23:02:06.378 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:02:06.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T23:02:06.429 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:06.426+0000 7f53b6799040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T23:02:06.435 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:06.433+0000 7f0ab0a14040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-17T23:02:06.444 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:02:06.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T23:02:06.493 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:06.491+0000 7f0ab0a14040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-17T23:02:06.510 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:02:06.510 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T23:02:06.576 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:02:06.576 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T23:02:06.577 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:06.574+0000 7f53b6799040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T23:02:06.601 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:02:06.601 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T23:02:06.654 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:06.651+0000 7f0ab0a14040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-17T23:02:06.666 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:02:06.666 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T23:02:06.732 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-09-17T23:02:06.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T23:02:06.796 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 69fa22ee-5c14-4f80-82fe-b22939183e4a 0 2024-09-17T23:02:07.020 INFO:teuthology.orchestra.run.smithi152.stdout:0 2024-09-17T23:02:07.031 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new a50256db-895f-4a6b-b83e-e251a3b53e10 1 2024-09-17T23:02:07.216 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-09-17T23:02:07.227 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2 2 2024-09-17T23:02:07.411 INFO:teuthology.orchestra.run.smithi152.stdout:2 2024-09-17T23:02:07.422 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new b9664ac0-db52-42bb-aa10-9ad23cc7021a 3 2024-09-17T23:02:07.600 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:07.598+0000 7f53b6799040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T23:02:07.601 INFO:teuthology.orchestra.run.smithi152.stdout:3 2024-09-17T23:02:07.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 5a11b2ff-7a67-40ed-8076-90ce187a3d96 4 2024-09-17T23:02:07.656 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:07.654+0000 7f0ab0a14040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-17T23:02:07.657 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:07.654+0000 7f53b6799040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T23:02:07.712 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:07.709+0000 7f0ab0a14040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-17T23:02:07.793 INFO:teuthology.orchestra.run.smithi152.stdout:4 2024-09-17T23:02:07.805 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 2361e4e6-f10b-417b-a976-a037ac890e11 5 2024-09-17T23:02:07.985 INFO:teuthology.orchestra.run.smithi152.stdout:5 2024-09-17T23:02:07.997 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 8d3a457f-9981-4307-ac8e-4d45f1600ade 6 2024-09-17T23:02:08.045 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.042+0000 7f53b6799040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T23:02:08.102 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.100+0000 7f0ab0a14040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-17T23:02:08.134 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.132+0000 7f53b6799040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T23:02:08.177 INFO:teuthology.orchestra.run.smithi152.stdout:6 2024-09-17T23:02:08.188 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3 7 2024-09-17T23:02:08.192 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.190+0000 7f0ab0a14040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-17T23:02:08.247 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.245+0000 7f53b6799040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T23:02:08.296 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.294+0000 7f53b6799040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T23:02:08.304 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.302+0000 7f0ab0a14040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-17T23:02:08.353 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.350+0000 7f0ab0a14040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-17T23:02:08.366 INFO:teuthology.orchestra.run.smithi152.stdout:7 2024-09-17T23:02:08.377 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T23:02:08.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T23:02:08.379 INFO:tasks.ceph.osd.0:Started 2024-09-17T23:02:08.379 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T23:02:08.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T23:02:08.381 INFO:tasks.ceph.osd.1:Started 2024-09-17T23:02:08.381 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T23:02:08.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T23:02:08.384 INFO:tasks.ceph.osd.2:Started 2024-09-17T23:02:08.384 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T23:02:08.384 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T23:02:08.386 INFO:tasks.ceph.osd.3:Started 2024-09-17T23:02:08.386 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T23:02:08.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T23:02:08.389 INFO:tasks.ceph.osd.4:Started 2024-09-17T23:02:08.389 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T23:02:08.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T23:02:08.391 INFO:tasks.ceph.osd.5:Started 2024-09-17T23:02:08.391 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T23:02:08.391 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T23:02:08.393 INFO:tasks.ceph.osd.6:Started 2024-09-17T23:02:08.393 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T23:02:08.393 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T23:02:08.395 INFO:tasks.ceph.osd.7:Started 2024-09-17T23:02:08.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T23:02:08.423 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.420+0000 7f53b6799040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T23:02:08.494 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.491+0000 7f53b6799040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T23:02:08.510 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.508+0000 7f0ab0a14040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-17T23:02:08.539 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.537+0000 7f53b6799040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T23:02:08.569 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.566+0000 7f0ab0a14040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-17T23:02:08.603 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:08.603 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":10,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:02:08.362331+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T23:02:08.362331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:02:08.614 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T23:02:08.614 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T23:02:08.617 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.614+0000 7f0ab0a14040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-17T23:02:08.651 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.648+0000 7f53b6799040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T23:02:08.700 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.698+0000 7f53b6799040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T23:02:08.734 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.732+0000 7f0ab0a14040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-17T23:02:08.751 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.749+0000 7f53b6799040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T23:02:08.787 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.785+0000 7f0ab0a14040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-17T23:02:08.820 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.818+0000 7f53b6799040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T23:02:08.841 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.839+0000 7f0ab0a14040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-17T23:02:08.864 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.861+0000 7f53b6799040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T23:02:08.907 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:08.905+0000 7f53b6799040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T23:02:08.912 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.910+0000 7f0ab0a14040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-17T23:02:08.959 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:08.956+0000 7f0ab0a14040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-17T23:02:09.005 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:09.003+0000 7f0ab0a14040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-17T23:02:09.420 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T23:02:09.563 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:09.561+0000 7f53b6799040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T23:02:09.585 INFO:teuthology.misc.health.smithi005.stdout: 2024-09-17T23:02:09.585 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":10,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:02:08.362331+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T23:02:08.362331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:02:09.597 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T23:02:09.701 INFO:tasks.ceph.mgr.y.smithi005.stderr:2024-09-17T23:02:09.698+0000 7f0ab0a14040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-17T23:02:09.846 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:09.843+0000 7f96ca543640 -1 Falling back to public interface 2024-09-17T23:02:09.868 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:09.865+0000 7f45b1215640 -1 Falling back to public interface 2024-09-17T23:02:10.122 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:10.119+0000 7f02f4e24640 -1 Falling back to public interface 2024-09-17T23:02:10.337 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:10.334+0000 7fb45ea44640 -1 Falling back to public interface 2024-09-17T23:02:10.354 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-17T23:02:10.351+0000 7ff94cce8640 -1 Falling back to public interface 2024-09-17T23:02:10.355 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:10.352+0000 7f5589bcc640 -1 Falling back to public interface 2024-09-17T23:02:10.371 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:10.368+0000 7f9dd7fb2640 -1 Falling back to public interface 2024-09-17T23:02:10.380 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:10.377+0000 7f48fda0d640 -1 Falling back to public interface 2024-09-17T23:02:10.576 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:10.573+0000 7f5357069640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T23:02:10.576 INFO:tasks.ceph.mgr.x.smithi152.stderr:2024-09-17T23:02:10.573+0000 7f5357069640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T23:02:13.895 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:13.892+0000 7f96ca543640 -1 osd.0 0 log_to_monitors true 2024-09-17T23:02:13.935 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:13.932+0000 7f45b1215640 -1 osd.3 0 log_to_monitors true 2024-09-17T23:02:14.115 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-17T23:02:14.112+0000 7ff94cce8640 -1 osd.1 0 log_to_monitors true 2024-09-17T23:02:14.364 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:14.361+0000 7f5589bcc640 -1 osd.5 0 log_to_monitors true 2024-09-17T23:02:14.412 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:14.409+0000 7f02f4e24640 -1 osd.6 0 log_to_monitors true 2024-09-17T23:02:14.437 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:14.435+0000 7f48fda0d640 -1 osd.2 0 log_to_monitors true 2024-09-17T23:02:14.457 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:14.454+0000 7f9dd7fb2640 -1 osd.7 0 log_to_monitors true 2024-09-17T23:02:14.567 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:14.565+0000 7fb45ea44640 -1 osd.4 0 log_to_monitors true 2024-09-17T23:02:16.405 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T23:02:16.961 INFO:teuthology.misc.health.smithi005.stdout: 2024-09-17T23:02:16.961 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":12,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:02:15.586035+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T23:02:08.362331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:02:16.979 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T23:02:17.194 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:17.192+0000 7f48f8b6f640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T23:02:17.209 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:17.207+0000 7f48f11a1640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:02:17.234 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-17T23:02:17.232+0000 7ff94948b640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T23:02:17.247 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-17T23:02:17.245+0000 7ff940a86640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:02:17.257 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:17.255+0000 7f45ac303640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T23:02:17.273 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:17.271+0000 7f45a4935640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:02:17.325 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:17.322+0000 7f96c6ce6640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T23:02:17.339 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:17.337+0000 7f96be2e1640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:02:17.651 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:17.649+0000 7f5585338640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T23:02:17.662 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:17.660+0000 7f557d96a640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:02:17.800 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:17.798+0000 7f9dd371e640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T23:02:17.807 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:17.804+0000 7f02efef1640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T23:02:17.812 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:17.810+0000 7f9dcbd50640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:02:17.824 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:17.822+0000 7f02e8523640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:02:17.831 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:17.829+0000 7fb45b1e7640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T23:02:17.846 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:17.844+0000 7fb4527e2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:02:23.786 DEBUG:teuthology.orchestra.run.smithi005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T23:02:24.081 INFO:teuthology.misc.health.smithi005.stdout: 2024-09-17T23:02:24.082 INFO:teuthology.misc.health.smithi005.stdout:{"epoch":17,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:02:22.208434+0000","last_up_change":"2024-09-17T23:02:18.195129+0000","last_in_change":"2024-09-17T23:02:08.362331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T23:02:19.615759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6801","nonce":3261733059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6803","nonce":3261733059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6807","nonce":3261733059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6805","nonce":3261733059}]},"public_addr":"172.21.15.5:6801/3261733059","cluster_addr":"172.21.15.5:6803/3261733059","heartbeat_back_addr":"172.21.15.5:6807/3261733059","heartbeat_front_addr":"172.21.15.5:6805/3261733059","state":["exists","up"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6817","nonce":3745424715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6819","nonce":3745424715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6823","nonce":3745424715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6821","nonce":3745424715}]},"public_addr":"172.21.15.5:6817/3745424715","cluster_addr":"172.21.15.5:6819/3745424715","heartbeat_back_addr":"172.21.15.5:6823/3745424715","heartbeat_front_addr":"172.21.15.5:6821/3745424715","state":["exists","up"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6825","nonce":3492189306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6827","nonce":3492189306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6831","nonce":3492189306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6829","nonce":3492189306}]},"public_addr":"172.21.15.5:6825/3492189306","cluster_addr":"172.21.15.5:6827/3492189306","heartbeat_back_addr":"172.21.15.5:6831/3492189306","heartbeat_front_addr":"172.21.15.5:6829/3492189306","state":["exists","up"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6809","nonce":1475101831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6811","nonce":1475101831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6815","nonce":1475101831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6813","nonce":1475101831}]},"public_addr":"172.21.15.5:6809/1475101831","cluster_addr":"172.21.15.5:6811/1475101831","heartbeat_back_addr":"172.21.15.5:6815/1475101831","heartbeat_front_addr":"172.21.15.5:6813/1475101831","state":["exists","up"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6811","nonce":1406375140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6813","nonce":1406375140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6817","nonce":1406375140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6815","nonce":1406375140}]},"public_addr":"172.21.15.152:6811/1406375140","cluster_addr":"172.21.15.152:6813/1406375140","heartbeat_back_addr":"172.21.15.152:6817/1406375140","heartbeat_front_addr":"172.21.15.152:6815/1406375140","state":["exists","up"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6819","nonce":2095030613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6821","nonce":2095030613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6825","nonce":2095030613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6823","nonce":2095030613}]},"public_addr":"172.21.15.152:6819/2095030613","cluster_addr":"172.21.15.152:6821/2095030613","heartbeat_back_addr":"172.21.15.152:6825/2095030613","heartbeat_front_addr":"172.21.15.152:6823/2095030613","state":["exists","up"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6803","nonce":3030792595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6805","nonce":3030792595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6809","nonce":3030792595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6807","nonce":3030792595}]},"public_addr":"172.21.15.152:6803/3030792595","cluster_addr":"172.21.15.152:6805/3030792595","heartbeat_back_addr":"172.21.15.152:6809/3030792595","heartbeat_front_addr":"172.21.15.152:6807/3030792595","state":["exists","up"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6827","nonce":967279289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6829","nonce":967279289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6833","nonce":967279289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6831","nonce":967279289}]},"public_addr":"172.21.15.152:6827/967279289","cluster_addr":"172.21.15.152:6829/967279289","heartbeat_back_addr":"172.21.15.152:6833/967279289","heartbeat_front_addr":"172.21.15.152:6831/967279289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.899917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.157860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.416164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.907974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.523463+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.326314+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.363775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.492325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:02:24.093 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T23:02:24.093 INFO:tasks.ceph:Creating RBD pool 2024-09-17T23:02:24.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-17T23:02:25.228 INFO:teuthology.orchestra.run.smithi005.stderr:pool 'rbd' created 2024-09-17T23:02:25.246 DEBUG:teuthology.orchestra.run.smithi005:> rbd --cluster ceph pool init rbd 2024-09-17T23:02:28.254 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T23:02:28.255 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T23:02:28.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T23:02:28.255 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T23:02:28.256 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T23:02:28.611 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:28.622 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":6,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":2622135642},{"type":"v1","addr":"172.21.15.152:6801","nonce":2622135642}]},"active_addr":"172.21.15.152:6801/2622135642","active_change":"2024-09-17T23:02:09.563480+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":1416785868}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2491191468}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":2407500907}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":851416542}]}]} 2024-09-17T23:02:28.627 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T23:02:28.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T23:02:28.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T23:02:28.919 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:28.919 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:02:28.236047+0000","last_up_change":"2024-09-17T23:02:18.195129+0000","last_in_change":"2024-09-17T23:02:08.362331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T23:02:19.615759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T23:02:24.412869+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6801","nonce":3261733059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6803","nonce":3261733059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6807","nonce":3261733059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6805","nonce":3261733059}]},"public_addr":"172.21.15.5:6801/3261733059","cluster_addr":"172.21.15.5:6803/3261733059","heartbeat_back_addr":"172.21.15.5:6807/3261733059","heartbeat_front_addr":"172.21.15.5:6805/3261733059","state":["exists","up"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6817","nonce":3745424715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6819","nonce":3745424715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6823","nonce":3745424715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6821","nonce":3745424715}]},"public_addr":"172.21.15.5:6817/3745424715","cluster_addr":"172.21.15.5:6819/3745424715","heartbeat_back_addr":"172.21.15.5:6823/3745424715","heartbeat_front_addr":"172.21.15.5:6821/3745424715","state":["exists","up"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6825","nonce":3492189306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6827","nonce":3492189306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6831","nonce":3492189306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6829","nonce":3492189306}]},"public_addr":"172.21.15.5:6825/3492189306","cluster_addr":"172.21.15.5:6827/3492189306","heartbeat_back_addr":"172.21.15.5:6831/3492189306","heartbeat_front_addr":"172.21.15.5:6829/3492189306","state":["exists","up"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6809","nonce":1475101831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6811","nonce":1475101831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6815","nonce":1475101831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6813","nonce":1475101831}]},"public_addr":"172.21.15.5:6809/1475101831","cluster_addr":"172.21.15.5:6811/1475101831","heartbeat_back_addr":"172.21.15.5:6815/1475101831","heartbeat_front_addr":"172.21.15.5:6813/1475101831","state":["exists","up"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6811","nonce":1406375140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6813","nonce":1406375140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6817","nonce":1406375140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6815","nonce":1406375140}]},"public_addr":"172.21.15.152:6811/1406375140","cluster_addr":"172.21.15.152:6813/1406375140","heartbeat_back_addr":"172.21.15.152:6817/1406375140","heartbeat_front_addr":"172.21.15.152:6815/1406375140","state":["exists","up"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6819","nonce":2095030613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6821","nonce":2095030613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6825","nonce":2095030613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6823","nonce":2095030613}]},"public_addr":"172.21.15.152:6819/2095030613","cluster_addr":"172.21.15.152:6821/2095030613","heartbeat_back_addr":"172.21.15.152:6825/2095030613","heartbeat_front_addr":"172.21.15.152:6823/2095030613","state":["exists","up"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6803","nonce":3030792595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6805","nonce":3030792595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6809","nonce":3030792595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6807","nonce":3030792595}]},"public_addr":"172.21.15.152:6803/3030792595","cluster_addr":"172.21.15.152:6805/3030792595","heartbeat_back_addr":"172.21.15.152:6809/3030792595","heartbeat_front_addr":"172.21.15.152:6807/3030792595","state":["exists","up"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6827","nonce":967279289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6829","nonce":967279289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6833","nonce":967279289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6831","nonce":967279289}]},"public_addr":"172.21.15.152:6827/967279289","cluster_addr":"172.21.15.152:6829/967279289","heartbeat_back_addr":"172.21.15.152:6833/967279289","heartbeat_front_addr":"172.21.15.152:6831/967279289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.899917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.157860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.416164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.907974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.523463+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.326314+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.363775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.492325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:02:28.932 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T23:02:28.932 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T23:02:29.222 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:29.222 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":21,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:02:28.236047+0000","last_up_change":"2024-09-17T23:02:18.195129+0000","last_in_change":"2024-09-17T23:02:08.362331+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T23:02:19.615759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T23:02:24.412869+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6801","nonce":3261733059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6803","nonce":3261733059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6807","nonce":3261733059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6805","nonce":3261733059}]},"public_addr":"172.21.15.5:6801/3261733059","cluster_addr":"172.21.15.5:6803/3261733059","heartbeat_back_addr":"172.21.15.5:6807/3261733059","heartbeat_front_addr":"172.21.15.5:6805/3261733059","state":["exists","up"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6817","nonce":3745424715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6819","nonce":3745424715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6823","nonce":3745424715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":3745424715},{"type":"v1","addr":"172.21.15.5:6821","nonce":3745424715}]},"public_addr":"172.21.15.5:6817/3745424715","cluster_addr":"172.21.15.5:6819/3745424715","heartbeat_back_addr":"172.21.15.5:6823/3745424715","heartbeat_front_addr":"172.21.15.5:6821/3745424715","state":["exists","up"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6825","nonce":3492189306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6827","nonce":3492189306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6831","nonce":3492189306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":3492189306},{"type":"v1","addr":"172.21.15.5:6829","nonce":3492189306}]},"public_addr":"172.21.15.5:6825/3492189306","cluster_addr":"172.21.15.5:6827/3492189306","heartbeat_back_addr":"172.21.15.5:6831/3492189306","heartbeat_front_addr":"172.21.15.5:6829/3492189306","state":["exists","up"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6809","nonce":1475101831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6811","nonce":1475101831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6815","nonce":1475101831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6813","nonce":1475101831}]},"public_addr":"172.21.15.5:6809/1475101831","cluster_addr":"172.21.15.5:6811/1475101831","heartbeat_back_addr":"172.21.15.5:6815/1475101831","heartbeat_front_addr":"172.21.15.5:6813/1475101831","state":["exists","up"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6811","nonce":1406375140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6813","nonce":1406375140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6817","nonce":1406375140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6815","nonce":1406375140}]},"public_addr":"172.21.15.152:6811/1406375140","cluster_addr":"172.21.15.152:6813/1406375140","heartbeat_back_addr":"172.21.15.152:6817/1406375140","heartbeat_front_addr":"172.21.15.152:6815/1406375140","state":["exists","up"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6819","nonce":2095030613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6821","nonce":2095030613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6825","nonce":2095030613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6823","nonce":2095030613}]},"public_addr":"172.21.15.152:6819/2095030613","cluster_addr":"172.21.15.152:6821/2095030613","heartbeat_back_addr":"172.21.15.152:6825/2095030613","heartbeat_front_addr":"172.21.15.152:6823/2095030613","state":["exists","up"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6803","nonce":3030792595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6805","nonce":3030792595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6809","nonce":3030792595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6807","nonce":3030792595}]},"public_addr":"172.21.15.152:6803/3030792595","cluster_addr":"172.21.15.152:6805/3030792595","heartbeat_back_addr":"172.21.15.152:6809/3030792595","heartbeat_front_addr":"172.21.15.152:6807/3030792595","state":["exists","up"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6827","nonce":967279289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6829","nonce":967279289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6833","nonce":967279289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":967279289},{"type":"v1","addr":"172.21.15.152:6831","nonce":967279289}]},"public_addr":"172.21.15.152:6827/967279289","cluster_addr":"172.21.15.152:6829/967279289","heartbeat_back_addr":"172.21.15.152:6833/967279289","heartbeat_front_addr":"172.21.15.152:6831/967279289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.899917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.157860+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.416164+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.907974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.523463+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.326314+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.363775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.492325+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:02:29.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T23:02:29.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T23:02:29.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T23:02:29.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T23:02:29.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T23:02:29.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T23:02:29.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T23:02:29.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T23:02:29.491 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-09-17T23:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:29.492 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-09-17T23:02:29.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T23:02:29.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T23:02:29.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T23:02:29.495 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-17T23:02:29.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T23:02:29.496 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:29.496 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T23:02:29.497 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-17T23:02:29.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T23:02:29.498 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-17T23:02:29.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T23:02:29.499 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:29.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T23:02:30.127 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:30.129 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:30.142 INFO:teuthology.orchestra.run.smithi005.stdout:55834574851 2024-09-17T23:02:30.145 INFO:teuthology.orchestra.run.smithi005.stdout:55834574850 2024-09-17T23:02:30.146 INFO:teuthology.orchestra.run.smithi005.stdout:55834574850 2024-09-17T23:02:30.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.0 2024-09-17T23:02:30.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.5 2024-09-17T23:02:30.154 INFO:teuthology.orchestra.run.smithi005.stdout:55834574850 2024-09-17T23:02:30.158 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:30.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.1 2024-09-17T23:02:30.162 INFO:teuthology.orchestra.run.smithi005.stdout:55834574851 2024-09-17T23:02:30.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.7 2024-09-17T23:02:30.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.2 2024-09-17T23:02:30.174 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.3 2024-09-17T23:02:30.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2024-09-17T23:02:30.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.6 2024-09-17T23:02:31.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T23:02:31.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T23:02:31.162 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T23:02:31.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T23:02:31.171 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T23:02:31.175 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T23:02:31.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T23:02:31.183 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T23:02:31.744 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-17T23:02:31.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-17T23:02:31.765 DEBUG:teuthology.parallel:result is None 2024-09-17T23:02:31.773 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-17T23:02:31.790 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:31.792 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-17T23:02:31.793 DEBUG:teuthology.parallel:result is None 2024-09-17T23:02:31.801 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:31.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-09-17T23:02:31.804 DEBUG:teuthology.parallel:result is None 2024-09-17T23:02:31.805 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-09-17T23:02:31.808 INFO:teuthology.orchestra.run.smithi005.stdout:55834574854 2024-09-17T23:02:31.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-09-17T23:02:31.817 DEBUG:teuthology.parallel:result is None 2024-09-17T23:02:31.818 INFO:teuthology.orchestra.run.smithi005.stdout:55834574852 2024-09-17T23:02:31.821 INFO:teuthology.orchestra.run.smithi005.stdout:55834574853 2024-09-17T23:02:31.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-09-17T23:02:31.823 DEBUG:teuthology.parallel:result is None 2024-09-17T23:02:31.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-17T23:02:31.824 DEBUG:teuthology.parallel:result is None 2024-09-17T23:02:31.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2024-09-17T23:02:31.833 DEBUG:teuthology.parallel:result is None 2024-09-17T23:02:31.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-09-17T23:02:31.835 DEBUG:teuthology.parallel:result is None 2024-09-17T23:02:31.835 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T23:02:31.835 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:02:32.163 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:32.163 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:02:32.175 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-17T23:02:31.570805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235776,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738944,"statfs":{"total":773094113280,"available":772852678656,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001153"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.242504+0000","last_change":"2024-09-17T23:02:28.242504+0000","last_active":"2024-09-17T23:02:28.242504+0000","last_peered":"2024-09-17T23:02:28.242504+0000","last_clean":"2024-09-17T23:02:28.242504+0000","last_became_active":"2024-09-17T23:02:26.239779+0000","last_became_peered":"2024-09-17T23:02:26.239779+0000","last_unstale":"2024-09-17T23:02:28.242504+0000","last_undegraded":"2024-09-17T23:02:28.242504+0000","last_fullsized":"2024-09-17T23:02:28.242504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:25:35.187289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.248239+0000","last_change":"2024-09-17T23:02:28.248239+0000","last_active":"2024-09-17T23:02:28.248239+0000","last_peered":"2024-09-17T23:02:28.248239+0000","last_clean":"2024-09-17T23:02:28.248239+0000","last_became_active":"2024-09-17T23:02:26.237627+0000","last_became_peered":"2024-09-17T23:02:26.237627+0000","last_unstale":"2024-09-17T23:02:28.248239+0000","last_undegraded":"2024-09-17T23:02:28.248239+0000","last_fullsized":"2024-09-17T23:02:28.248239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:56:34.719403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047742999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467862+0000","last_change":"2024-09-17T23:02:28.467862+0000","last_active":"2024-09-17T23:02:28.467862+0000","last_peered":"2024-09-17T23:02:28.467862+0000","last_clean":"2024-09-17T23:02:28.467862+0000","last_became_active":"2024-09-17T23:02:26.809635+0000","last_became_peered":"2024-09-17T23:02:26.809635+0000","last_unstale":"2024-09-17T23:02:28.467862+0000","last_undegraded":"2024-09-17T23:02:28.467862+0000","last_fullsized":"2024-09-17T23:02:28.467862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:36.477332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.248195+0000","last_change":"2024-09-17T23:02:28.248195+0000","last_active":"2024-09-17T23:02:28.248195+0000","last_peered":"2024-09-17T23:02:28.248195+0000","last_clean":"2024-09-17T23:02:28.248195+0000","last_became_active":"2024-09-17T23:02:26.809343+0000","last_became_peered":"2024-09-17T23:02:26.809343+0000","last_unstale":"2024-09-17T23:02:28.248195+0000","last_undegraded":"2024-09-17T23:02:28.248195+0000","last_fullsized":"2024-09-17T23:02:28.248195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:43:45.312628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046964100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.247733+0000","last_change":"2024-09-17T23:02:28.246423+0000","last_active":"2024-09-17T23:02:28.247733+0000","last_peered":"2024-09-17T23:02:28.247733+0000","last_clean":"2024-09-17T23:02:28.247733+0000","last_became_active":"2024-09-17T23:02:26.238448+0000","last_became_peered":"2024-09-17T23:02:26.238448+0000","last_unstale":"2024-09-17T23:02:28.247733+0000","last_undegraded":"2024-09-17T23:02:28.247733+0000","last_fullsized":"2024-09-17T23:02:28.247733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:43.086820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.242589+0000","last_change":"2024-09-17T23:02:28.242589+0000","last_active":"2024-09-17T23:02:28.242589+0000","last_peered":"2024-09-17T23:02:28.242589+0000","last_clean":"2024-09-17T23:02:28.242589+0000","last_became_active":"2024-09-17T23:02:26.238780+0000","last_became_peered":"2024-09-17T23:02:26.238780+0000","last_unstale":"2024-09-17T23:02:28.242589+0000","last_undegraded":"2024-09-17T23:02:28.242589+0000","last_fullsized":"2024-09-17T23:02:28.242589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:12:18.801672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044709600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467826+0000","last_change":"2024-09-17T23:02:28.467826+0000","last_active":"2024-09-17T23:02:28.467826+0000","last_peered":"2024-09-17T23:02:28.467826+0000","last_clean":"2024-09-17T23:02:28.467826+0000","last_became_active":"2024-09-17T23:02:26.237434+0000","last_became_peered":"2024-09-17T23:02:26.237434+0000","last_unstale":"2024-09-17T23:02:28.467826+0000","last_undegraded":"2024-09-17T23:02:28.467826+0000","last_fullsized":"2024-09-17T23:02:28.467826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:43.303580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.245906+0000","last_change":"2024-09-17T23:02:28.245906+0000","last_active":"2024-09-17T23:02:28.245906+0000","last_peered":"2024-09-17T23:02:28.245906+0000","last_clean":"2024-09-17T23:02:28.245906+0000","last_became_active":"2024-09-17T23:02:26.238139+0000","last_became_peered":"2024-09-17T23:02:26.238139+0000","last_unstale":"2024-09-17T23:02:28.245906+0000","last_undegraded":"2024-09-17T23:02:28.245906+0000","last_fullsized":"2024-09-17T23:02:28.245906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:18.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467345+0000","last_change":"2024-09-17T23:02:21.400008+0000","last_active":"2024-09-17T23:02:28.467345+0000","last_peered":"2024-09-17T23:02:28.467345+0000","last_clean":"2024-09-17T23:02:28.467345+0000","last_became_active":"2024-09-17T23:02:21.398946+0000","last_became_peered":"2024-09-17T23:02:21.398946+0000","last_unstale":"2024-09-17T23:02:28.467345+0000","last_undegraded":"2024-09-17T23:02:28.467345+0000","last_fullsized":"2024-09-17T23:02:28.467345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:16.204902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:02:32.176 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:02:32.464 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:32.464 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:02:32.476 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-17T23:02:31.570805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235776,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738944,"statfs":{"total":773094113280,"available":772852678656,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001153"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.242504+0000","last_change":"2024-09-17T23:02:28.242504+0000","last_active":"2024-09-17T23:02:28.242504+0000","last_peered":"2024-09-17T23:02:28.242504+0000","last_clean":"2024-09-17T23:02:28.242504+0000","last_became_active":"2024-09-17T23:02:26.239779+0000","last_became_peered":"2024-09-17T23:02:26.239779+0000","last_unstale":"2024-09-17T23:02:28.242504+0000","last_undegraded":"2024-09-17T23:02:28.242504+0000","last_fullsized":"2024-09-17T23:02:28.242504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:25:35.187289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.248239+0000","last_change":"2024-09-17T23:02:28.248239+0000","last_active":"2024-09-17T23:02:28.248239+0000","last_peered":"2024-09-17T23:02:28.248239+0000","last_clean":"2024-09-17T23:02:28.248239+0000","last_became_active":"2024-09-17T23:02:26.237627+0000","last_became_peered":"2024-09-17T23:02:26.237627+0000","last_unstale":"2024-09-17T23:02:28.248239+0000","last_undegraded":"2024-09-17T23:02:28.248239+0000","last_fullsized":"2024-09-17T23:02:28.248239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:56:34.719403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047742999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467862+0000","last_change":"2024-09-17T23:02:28.467862+0000","last_active":"2024-09-17T23:02:28.467862+0000","last_peered":"2024-09-17T23:02:28.467862+0000","last_clean":"2024-09-17T23:02:28.467862+0000","last_became_active":"2024-09-17T23:02:26.809635+0000","last_became_peered":"2024-09-17T23:02:26.809635+0000","last_unstale":"2024-09-17T23:02:28.467862+0000","last_undegraded":"2024-09-17T23:02:28.467862+0000","last_fullsized":"2024-09-17T23:02:28.467862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:36.477332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.248195+0000","last_change":"2024-09-17T23:02:28.248195+0000","last_active":"2024-09-17T23:02:28.248195+0000","last_peered":"2024-09-17T23:02:28.248195+0000","last_clean":"2024-09-17T23:02:28.248195+0000","last_became_active":"2024-09-17T23:02:26.809343+0000","last_became_peered":"2024-09-17T23:02:26.809343+0000","last_unstale":"2024-09-17T23:02:28.248195+0000","last_undegraded":"2024-09-17T23:02:28.248195+0000","last_fullsized":"2024-09-17T23:02:28.248195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:43:45.312628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046964100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.247733+0000","last_change":"2024-09-17T23:02:28.246423+0000","last_active":"2024-09-17T23:02:28.247733+0000","last_peered":"2024-09-17T23:02:28.247733+0000","last_clean":"2024-09-17T23:02:28.247733+0000","last_became_active":"2024-09-17T23:02:26.238448+0000","last_became_peered":"2024-09-17T23:02:26.238448+0000","last_unstale":"2024-09-17T23:02:28.247733+0000","last_undegraded":"2024-09-17T23:02:28.247733+0000","last_fullsized":"2024-09-17T23:02:28.247733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:43.086820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.242589+0000","last_change":"2024-09-17T23:02:28.242589+0000","last_active":"2024-09-17T23:02:28.242589+0000","last_peered":"2024-09-17T23:02:28.242589+0000","last_clean":"2024-09-17T23:02:28.242589+0000","last_became_active":"2024-09-17T23:02:26.238780+0000","last_became_peered":"2024-09-17T23:02:26.238780+0000","last_unstale":"2024-09-17T23:02:28.242589+0000","last_undegraded":"2024-09-17T23:02:28.242589+0000","last_fullsized":"2024-09-17T23:02:28.242589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:12:18.801672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044709600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467826+0000","last_change":"2024-09-17T23:02:28.467826+0000","last_active":"2024-09-17T23:02:28.467826+0000","last_peered":"2024-09-17T23:02:28.467826+0000","last_clean":"2024-09-17T23:02:28.467826+0000","last_became_active":"2024-09-17T23:02:26.237434+0000","last_became_peered":"2024-09-17T23:02:26.237434+0000","last_unstale":"2024-09-17T23:02:28.467826+0000","last_undegraded":"2024-09-17T23:02:28.467826+0000","last_fullsized":"2024-09-17T23:02:28.467826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:43.303580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.245906+0000","last_change":"2024-09-17T23:02:28.245906+0000","last_active":"2024-09-17T23:02:28.245906+0000","last_peered":"2024-09-17T23:02:28.245906+0000","last_clean":"2024-09-17T23:02:28.245906+0000","last_became_active":"2024-09-17T23:02:26.238139+0000","last_became_peered":"2024-09-17T23:02:26.238139+0000","last_unstale":"2024-09-17T23:02:28.245906+0000","last_undegraded":"2024-09-17T23:02:28.245906+0000","last_fullsized":"2024-09-17T23:02:28.245906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:18.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467345+0000","last_change":"2024-09-17T23:02:21.400008+0000","last_active":"2024-09-17T23:02:28.467345+0000","last_peered":"2024-09-17T23:02:28.467345+0000","last_clean":"2024-09-17T23:02:28.467345+0000","last_became_active":"2024-09-17T23:02:21.398946+0000","last_became_peered":"2024-09-17T23:02:21.398946+0000","last_unstale":"2024-09-17T23:02:28.467345+0000","last_undegraded":"2024-09-17T23:02:28.467345+0000","last_fullsized":"2024-09-17T23:02:28.467345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:16.204902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:02:32.477 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T23:02:32.477 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T23:02:32.477 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T23:02:32.477 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T23:02:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:32.806 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T23:02:32.818 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T23:02:32.819 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-17T23:02:32.836 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-17T23:02:32.837 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c2ddf9721ef254645201cdbabd9c8f49c30a586f'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7'}} 2024-09-17T23:02:32.837 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-17T23:02:32.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-17T23:02:33.145 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-17T23:02:33.145 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T23:02:33.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:02:33.431 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:02:33.443 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-17T23:02:31.570805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235776,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738944,"statfs":{"total":773094113280,"available":772852678656,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001153"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.242504+0000","last_change":"2024-09-17T23:02:28.242504+0000","last_active":"2024-09-17T23:02:28.242504+0000","last_peered":"2024-09-17T23:02:28.242504+0000","last_clean":"2024-09-17T23:02:28.242504+0000","last_became_active":"2024-09-17T23:02:26.239779+0000","last_became_peered":"2024-09-17T23:02:26.239779+0000","last_unstale":"2024-09-17T23:02:28.242504+0000","last_undegraded":"2024-09-17T23:02:28.242504+0000","last_fullsized":"2024-09-17T23:02:28.242504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:25:35.187289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.248239+0000","last_change":"2024-09-17T23:02:28.248239+0000","last_active":"2024-09-17T23:02:28.248239+0000","last_peered":"2024-09-17T23:02:28.248239+0000","last_clean":"2024-09-17T23:02:28.248239+0000","last_became_active":"2024-09-17T23:02:26.237627+0000","last_became_peered":"2024-09-17T23:02:26.237627+0000","last_unstale":"2024-09-17T23:02:28.248239+0000","last_undegraded":"2024-09-17T23:02:28.248239+0000","last_fullsized":"2024-09-17T23:02:28.248239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:56:34.719403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047742999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467862+0000","last_change":"2024-09-17T23:02:28.467862+0000","last_active":"2024-09-17T23:02:28.467862+0000","last_peered":"2024-09-17T23:02:28.467862+0000","last_clean":"2024-09-17T23:02:28.467862+0000","last_became_active":"2024-09-17T23:02:26.809635+0000","last_became_peered":"2024-09-17T23:02:26.809635+0000","last_unstale":"2024-09-17T23:02:28.467862+0000","last_undegraded":"2024-09-17T23:02:28.467862+0000","last_fullsized":"2024-09-17T23:02:28.467862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:36.477332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.248195+0000","last_change":"2024-09-17T23:02:28.248195+0000","last_active":"2024-09-17T23:02:28.248195+0000","last_peered":"2024-09-17T23:02:28.248195+0000","last_clean":"2024-09-17T23:02:28.248195+0000","last_became_active":"2024-09-17T23:02:26.809343+0000","last_became_peered":"2024-09-17T23:02:26.809343+0000","last_unstale":"2024-09-17T23:02:28.248195+0000","last_undegraded":"2024-09-17T23:02:28.248195+0000","last_fullsized":"2024-09-17T23:02:28.248195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:43:45.312628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046964100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.247733+0000","last_change":"2024-09-17T23:02:28.246423+0000","last_active":"2024-09-17T23:02:28.247733+0000","last_peered":"2024-09-17T23:02:28.247733+0000","last_clean":"2024-09-17T23:02:28.247733+0000","last_became_active":"2024-09-17T23:02:26.238448+0000","last_became_peered":"2024-09-17T23:02:26.238448+0000","last_unstale":"2024-09-17T23:02:28.247733+0000","last_undegraded":"2024-09-17T23:02:28.247733+0000","last_fullsized":"2024-09-17T23:02:28.247733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:43.086820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.242589+0000","last_change":"2024-09-17T23:02:28.242589+0000","last_active":"2024-09-17T23:02:28.242589+0000","last_peered":"2024-09-17T23:02:28.242589+0000","last_clean":"2024-09-17T23:02:28.242589+0000","last_became_active":"2024-09-17T23:02:26.238780+0000","last_became_peered":"2024-09-17T23:02:26.238780+0000","last_unstale":"2024-09-17T23:02:28.242589+0000","last_undegraded":"2024-09-17T23:02:28.242589+0000","last_fullsized":"2024-09-17T23:02:28.242589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:12:18.801672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044709600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467826+0000","last_change":"2024-09-17T23:02:28.467826+0000","last_active":"2024-09-17T23:02:28.467826+0000","last_peered":"2024-09-17T23:02:28.467826+0000","last_clean":"2024-09-17T23:02:28.467826+0000","last_became_active":"2024-09-17T23:02:26.237434+0000","last_became_peered":"2024-09-17T23:02:26.237434+0000","last_unstale":"2024-09-17T23:02:28.467826+0000","last_undegraded":"2024-09-17T23:02:28.467826+0000","last_fullsized":"2024-09-17T23:02:28.467826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:43.303580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.245906+0000","last_change":"2024-09-17T23:02:28.245906+0000","last_active":"2024-09-17T23:02:28.245906+0000","last_peered":"2024-09-17T23:02:28.245906+0000","last_clean":"2024-09-17T23:02:28.245906+0000","last_became_active":"2024-09-17T23:02:26.238139+0000","last_became_peered":"2024-09-17T23:02:26.238139+0000","last_unstale":"2024-09-17T23:02:28.245906+0000","last_undegraded":"2024-09-17T23:02:28.245906+0000","last_fullsized":"2024-09-17T23:02:28.245906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:18.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467345+0000","last_change":"2024-09-17T23:02:21.400008+0000","last_active":"2024-09-17T23:02:28.467345+0000","last_peered":"2024-09-17T23:02:28.467345+0000","last_clean":"2024-09-17T23:02:28.467345+0000","last_became_active":"2024-09-17T23:02:21.398946+0000","last_became_peered":"2024-09-17T23:02:21.398946+0000","last_unstale":"2024-09-17T23:02:28.467345+0000","last_undegraded":"2024-09-17T23:02:28.467345+0000","last_fullsized":"2024-09-17T23:02:28.467345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:16.204902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:02:33.444 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:02:33.734 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:02:33.735 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:02:33.746 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-17T23:02:33.571179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235776,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738944,"statfs":{"total":773094113280,"available":772852678656,"internally_reserved":0,"allocated":2932736,"data_stored":1769310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.339174"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.242504+0000","last_change":"2024-09-17T23:02:28.242504+0000","last_active":"2024-09-17T23:02:28.242504+0000","last_peered":"2024-09-17T23:02:28.242504+0000","last_clean":"2024-09-17T23:02:28.242504+0000","last_became_active":"2024-09-17T23:02:26.239779+0000","last_became_peered":"2024-09-17T23:02:26.239779+0000","last_unstale":"2024-09-17T23:02:28.242504+0000","last_undegraded":"2024-09-17T23:02:28.242504+0000","last_fullsized":"2024-09-17T23:02:28.242504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:25:35.187289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.248239+0000","last_change":"2024-09-17T23:02:28.248239+0000","last_active":"2024-09-17T23:02:28.248239+0000","last_peered":"2024-09-17T23:02:28.248239+0000","last_clean":"2024-09-17T23:02:28.248239+0000","last_became_active":"2024-09-17T23:02:26.237627+0000","last_became_peered":"2024-09-17T23:02:26.237627+0000","last_unstale":"2024-09-17T23:02:28.248239+0000","last_undegraded":"2024-09-17T23:02:28.248239+0000","last_fullsized":"2024-09-17T23:02:28.248239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:56:34.719403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047742999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467862+0000","last_change":"2024-09-17T23:02:28.467862+0000","last_active":"2024-09-17T23:02:28.467862+0000","last_peered":"2024-09-17T23:02:28.467862+0000","last_clean":"2024-09-17T23:02:28.467862+0000","last_became_active":"2024-09-17T23:02:26.809635+0000","last_became_peered":"2024-09-17T23:02:26.809635+0000","last_unstale":"2024-09-17T23:02:28.467862+0000","last_undegraded":"2024-09-17T23:02:28.467862+0000","last_fullsized":"2024-09-17T23:02:28.467862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:36.477332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.248195+0000","last_change":"2024-09-17T23:02:28.248195+0000","last_active":"2024-09-17T23:02:28.248195+0000","last_peered":"2024-09-17T23:02:28.248195+0000","last_clean":"2024-09-17T23:02:28.248195+0000","last_became_active":"2024-09-17T23:02:26.809343+0000","last_became_peered":"2024-09-17T23:02:26.809343+0000","last_unstale":"2024-09-17T23:02:28.248195+0000","last_undegraded":"2024-09-17T23:02:28.248195+0000","last_fullsized":"2024-09-17T23:02:28.248195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:43:45.312628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046964100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.247733+0000","last_change":"2024-09-17T23:02:28.246423+0000","last_active":"2024-09-17T23:02:28.247733+0000","last_peered":"2024-09-17T23:02:28.247733+0000","last_clean":"2024-09-17T23:02:28.247733+0000","last_became_active":"2024-09-17T23:02:26.238448+0000","last_became_peered":"2024-09-17T23:02:26.238448+0000","last_unstale":"2024-09-17T23:02:28.247733+0000","last_undegraded":"2024-09-17T23:02:28.247733+0000","last_fullsized":"2024-09-17T23:02:28.247733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:19:43.086820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.242589+0000","last_change":"2024-09-17T23:02:28.242589+0000","last_active":"2024-09-17T23:02:28.242589+0000","last_peered":"2024-09-17T23:02:28.242589+0000","last_clean":"2024-09-17T23:02:28.242589+0000","last_became_active":"2024-09-17T23:02:26.238780+0000","last_became_peered":"2024-09-17T23:02:26.238780+0000","last_unstale":"2024-09-17T23:02:28.242589+0000","last_undegraded":"2024-09-17T23:02:28.242589+0000","last_fullsized":"2024-09-17T23:02:28.242589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:12:18.801672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044709600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467826+0000","last_change":"2024-09-17T23:02:28.467826+0000","last_active":"2024-09-17T23:02:28.467826+0000","last_peered":"2024-09-17T23:02:28.467826+0000","last_clean":"2024-09-17T23:02:28.467826+0000","last_became_active":"2024-09-17T23:02:26.237434+0000","last_became_peered":"2024-09-17T23:02:26.237434+0000","last_unstale":"2024-09-17T23:02:28.467826+0000","last_undegraded":"2024-09-17T23:02:28.467826+0000","last_fullsized":"2024-09-17T23:02:28.467826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:04:43.303580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.245906+0000","last_change":"2024-09-17T23:02:28.245906+0000","last_active":"2024-09-17T23:02:28.245906+0000","last_peered":"2024-09-17T23:02:28.245906+0000","last_clean":"2024-09-17T23:02:28.245906+0000","last_became_active":"2024-09-17T23:02:26.238139+0000","last_became_peered":"2024-09-17T23:02:26.238139+0000","last_unstale":"2024-09-17T23:02:28.245906+0000","last_undegraded":"2024-09-17T23:02:28.245906+0000","last_fullsized":"2024-09-17T23:02:28.245906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:18.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T23:02:28.467345+0000","last_change":"2024-09-17T23:02:21.400008+0000","last_active":"2024-09-17T23:02:28.467345+0000","last_peered":"2024-09-17T23:02:28.467345+0000","last_clean":"2024-09-17T23:02:28.467345+0000","last_became_active":"2024-09-17T23:02:21.398946+0000","last_became_peered":"2024-09-17T23:02:21.398946+0000","last_unstale":"2024-09-17T23:02:28.467345+0000","last_undegraded":"2024-09-17T23:02:28.467345+0000","last_fullsized":"2024-09-17T23:02:28.467345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:16.204902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27252,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":217088,"data_stored":73567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":811008,"data_stored":663935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:02:33.747 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T23:02:33.748 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-17T23:02:34.034 INFO:teuthology.orchestra.run.smithi005.stdout:epoch 21 2024-09-17T23:02:34.034 INFO:teuthology.orchestra.run.smithi005.stdout:fsid 4cb0491c-5273-43ce-9711-0f68bec58f2e 2024-09-17T23:02:34.034 INFO:teuthology.orchestra.run.smithi005.stdout:created 2024-09-17T23:02:05.418126+0000 2024-09-17T23:02:34.034 INFO:teuthology.orchestra.run.smithi005.stdout:modified 2024-09-17T23:02:28.236047+0000 2024-09-17T23:02:34.034 INFO:teuthology.orchestra.run.smithi005.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-17T23:02:34.034 INFO:teuthology.orchestra.run.smithi005.stdout:crush_version 4 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:full_ratio 0.95 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:backfillfull_ratio 0.9 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:nearfull_ratio 0.85 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:require_min_compat_client luminous 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:min_compat_client jewel 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:require_osd_release squid 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:stretch_mode_enabled false 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout: removed_snaps_queue [2~1] 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:max_osd 8 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6800/3261733059,v1:172.21.15.5:6801/3261733059] [v2:172.21.15.5:6802/3261733059,v1:172.21.15.5:6803/3261733059] exists,up 69fa22ee-5c14-4f80-82fe-b22939183e4a 2024-09-17T23:02:34.035 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6816/3745424715,v1:172.21.15.5:6817/3745424715] [v2:172.21.15.5:6818/3745424715,v1:172.21.15.5:6819/3745424715] exists,up a50256db-895f-4a6b-b83e-e251a3b53e10 2024-09-17T23:02:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6824/3492189306,v1:172.21.15.5:6825/3492189306] [v2:172.21.15.5:6826/3492189306,v1:172.21.15.5:6827/3492189306] exists,up c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2 2024-09-17T23:02:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6808/1475101831,v1:172.21.15.5:6809/1475101831] [v2:172.21.15.5:6810/1475101831,v1:172.21.15.5:6811/1475101831] exists,up b9664ac0-db52-42bb-aa10-9ad23cc7021a 2024-09-17T23:02:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6810/1406375140,v1:172.21.15.152:6811/1406375140] [v2:172.21.15.152:6812/1406375140,v1:172.21.15.152:6813/1406375140] exists,up 5a11b2ff-7a67-40ed-8076-90ce187a3d96 2024-09-17T23:02:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6818/2095030613,v1:172.21.15.152:6819/2095030613] [v2:172.21.15.152:6820/2095030613,v1:172.21.15.152:6821/2095030613] exists,up 2361e4e6-f10b-417b-a976-a037ac890e11 2024-09-17T23:02:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6802/3030792595,v1:172.21.15.152:6803/3030792595] [v2:172.21.15.152:6804/3030792595,v1:172.21.15.152:6805/3030792595] exists,up 8d3a457f-9981-4307-ac8e-4d45f1600ade 2024-09-17T23:02:34.036 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6826/967279289,v1:172.21.15.152:6827/967279289] [v2:172.21.15.152:6828/967279289,v1:172.21.15.152:6829/967279289] exists,up 0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3 2024-09-17T23:02:34.047 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6800/3261733059,v1:172.21.15.5:6801/3261733059] [v2:172.21.15.5:6802/3261733059,v1:172.21.15.5:6803/3261733059] exists,up 69fa22ee-5c14-4f80-82fe-b22939183e4a', 'osd.1 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6816/3745424715,v1:172.21.15.5:6817/3745424715] [v2:172.21.15.5:6818/3745424715,v1:172.21.15.5:6819/3745424715] exists,up a50256db-895f-4a6b-b83e-e251a3b53e10', 'osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6824/3492189306,v1:172.21.15.5:6825/3492189306] [v2:172.21.15.5:6826/3492189306,v1:172.21.15.5:6827/3492189306] exists,up c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.5:6808/1475101831,v1:172.21.15.5:6809/1475101831] [v2:172.21.15.5:6810/1475101831,v1:172.21.15.5:6811/1475101831] exists,up b9664ac0-db52-42bb-aa10-9ad23cc7021a', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6810/1406375140,v1:172.21.15.152:6811/1406375140] [v2:172.21.15.152:6812/1406375140,v1:172.21.15.152:6813/1406375140] exists,up 5a11b2ff-7a67-40ed-8076-90ce187a3d96', 'osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6818/2095030613,v1:172.21.15.152:6819/2095030613] [v2:172.21.15.152:6820/2095030613,v1:172.21.15.152:6821/2095030613] exists,up 2361e4e6-f10b-417b-a976-a037ac890e11', 'osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6802/3030792595,v1:172.21.15.152:6803/3030792595] [v2:172.21.15.152:6804/3030792595,v1:172.21.15.152:6805/3030792595] exists,up 8d3a457f-9981-4307-ac8e-4d45f1600ade', 'osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.152:6826/967279289,v1:172.21.15.152:6827/967279289] [v2:172.21.15.152:6828/967279289,v1:172.21.15.152:6829/967279289] exists,up 0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3'] 2024-09-17T23:02:34.047 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-17T23:02:34.149 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "mon.a", 2024-09-17T23:02:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster": "ceph", 2024-09-17T23:02:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-17T23:02:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "admin_socket_mode": "", 2024-09-17T23:02:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-17T23:02:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_client_required": "cephx, none", 2024-09-17T23:02:34.149 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_cluster_required": "cephx", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_debug": "true", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_service_required": "cephx", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "auth_supported": "cephx", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_aio": "true", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_aio_poll_ms": "250", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_aio_reap_max": "16", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_async_discard": "false", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_block_size": "4096", 2024-09-17T23:02:34.150 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_debug_aio": "false", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_debug_inflight_ios": "false", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_enable_discard": "false", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_flock_retry": "3", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_inject_crash": "0", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_ioring": "false", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_ioring_hipri": "false", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-17T23:02:34.151 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bdev_type": "", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_alloc_size": "1048576", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_allocator": "hybrid", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_buffered_io": "true", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_check_for_zeros": "false", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_compact_log_sync": "false", 2024-09-17T23:02:34.152 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_max_log_runway": "4194304", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_max_prefetch": "1048576", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_min_flush_size": "524288", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_min_log_runway": "1048576", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_replay_recovery": "false", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluefs_sync_write": "false", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-17T23:02:34.153 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_allocation_from_file": "true", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_allocator": "hybrid", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bdev_label_multi": "true", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-17T23:02:34.154 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_create": "true", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_db_create": "false", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_db_path": "", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_db_size": "0", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_path": "", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_preallocate_file": "false", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_size": "107374182400", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_wal_create": "false", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_wal_path": "", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_block_wal_size": "100663296", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bluefs": "true", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-17T23:02:34.155 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_autotune": "true", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-17T23:02:34.156 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_size": "0", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cache_type": "2q", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_clone_cow": "true", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-17T23:02:34.157 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_mode": "none", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_csum_type": "crc32c", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_freelist": "false", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-17T23:02:34.158 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_small_allocations": "0", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_default_buffered_read": "true", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_default_buffered_write": "false", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-17T23:02:34.159 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fail_eio": "false", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-17T23:02:34.160 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_mount": "false", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_umount": "false", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_ignore_data_csum": "false", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-17T23:02:34.161 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_log_op_age": "5.000000", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_alloc_size": "0", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_blob_size": "0", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_max_deferred_txc": "32", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_min_alloc_size": "0", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_nid_prealloc": "1024", 2024-09-17T23:02:34.162 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_retry_disk_reads": "3", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_rocksdb_cf": "true", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-17T23:02:34.163 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_spdk_mem": "512", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_tracing": "false", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-17T23:02:34.164 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "bluestore_zero_block_detection": "false", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-17T23:02:34.165 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_cluster_require_signatures": "false", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_cluster_require_version": "2", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_require_signatures": "false", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_require_version": "2", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_service_require_signatures": "false", 2024-09-17T23:02:34.166 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_service_require_version": "2", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "cephx_sign_messages": "true", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "chdir": "", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_acl_type": "", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_asio_thread_count": "2", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_cache_mid": "0.750000", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_cache_size": "16384", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_caps_release_delay": "5", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_check_pool_perm": "true", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_debug_force_sync_read": "false", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_debug_getattr_caps": "false", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_debug_inject_features": "", 2024-09-17T23:02:34.167 INFO:teuthology.orchestra.run.smithi005.stdout: "client_debug_inject_tick_delay": "0", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_die_on_failed_remount": "false", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_dirsize_rbytes": "true", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_force_lazyio": "false", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_fs": "", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_inject_release_failure": "false", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_max_inline_size": "4096", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mds_namespace": "", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_metadata": "", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mount_gid": "-1", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mount_timeout": "300", 2024-09-17T23:02:34.168 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mount_uid": "-1", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_mountpoint": "/", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_notify_timeout": "10", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc": "true", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_max_dirty": "104857600", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_max_objects": "1000", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_size": "209715200", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_oc_target_dirty": "8388608", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_permissions": "true", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_quota": "true", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_quota_df": "true", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_readahead_max_bytes": "0", 2024-09-17T23:02:34.169 INFO:teuthology.orchestra.run.smithi005.stdout: "client_readahead_max_periods": "4", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_readahead_min": "131072", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_reconnect_stale": "false", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_shutdown_timeout": "30", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_snapdir": ".snap", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_tick_interval": "1", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_trace": "", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_try_dentry_invalidate": "false", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_use_faked_inos": "false", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "client_use_random_mds": "false", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_graylog": "false", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_graylog_port": "12201", 2024-09-17T23:02:34.170 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_monitors": "default=true", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_syslog": "false", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "clog_to_syslog_level": "info", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "-", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_network": "", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_network_interface": "", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "compressor_zlib_isal": "false", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "compressor_zlib_level": "5", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "compressor_zlib_winsize": "-15", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "compressor_zstd_level": "1", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-17T23:02:34.171 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_alien_op_num_threads": "6", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_osd_stat_interval": "0", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_seastar_cpu_cores": "", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crimson_seastar_num_threads": "0", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location": "", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location_hook": "", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_location_hook_timeout": "10", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "daemonize": "false", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "daos_pool": "tank", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-17T23:02:34.172 INFO:teuthology.orchestra.run.smithi005.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_alienstore": "0/5", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_allow_any_pool_priority": "false", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_asok": "1/5", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_asok_assert_abort": "false", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_asserts_on_shutdown": "true", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_auth": "20/20", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_bdev": "1/3", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_bluefs": "1/5", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_bluestore": "1/5", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_buffer": "0/1", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_ceph_exporter": "1/5", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_cephfs_mirror": "0/5", 2024-09-17T23:02:34.173 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_cephsqlite": "0/5", 2024-09-17T23:02:34.174 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_client": "0/5", 2024-09-17T23:02:34.174 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_compressor": "1/5", 2024-09-17T23:02:34.174 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_context": "0/1", 2024-09-17T23:02:34.174 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_crimson_interrupt": "0/5", 2024-09-17T23:02:34.174 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_crush": "1/1", 2024-09-17T23:02:34.174 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_crypto": "1/5", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_cyanstore": "0/5", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_deliberately_leak_memory": "false", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_disable_randomized_ping": "false", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_dpdk": "1/5", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_eventtrace": "1/5", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_filer": "0/1", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_filestore": "1/3", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_finisher": "1/1", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_fuse": "1/5", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_heartbeat_testing_span": "0", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_heartbeatmap": "1/5", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-17T23:02:34.175 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_javaclient": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_journal": "1/3", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_journaler": "0/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_kstore": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_lockdep": "0/1", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mclock": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_balancer": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_locker": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_log": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_log_expire": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_migrator": "1/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mds_quiesce": "3/5", 2024-09-17T23:02:34.176 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_memstore": "1/5", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mgr": "2/5", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mgrc": "1/5", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_mon": "20/20", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_monc": "0/10", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_ms": "1/1", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_none": "0/5", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_objclass": "0/5", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_objectcacher": "0/5", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_objecter": "0/1", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_optracker": "0/5", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_osd": "1/5", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_paxos": "20/20", 2024-09-17T23:02:34.177 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_perfcounter": "1/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_prioritycache": "1/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rados": "0/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rbd": "0/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rbd_mirror": "0/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rbd_pwl": "0/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rbd_replay": "0/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_refs": "0/0", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_reserver": "1/1", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw": "1/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_access": "1/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_datacache": "1/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_dbstore": "1/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_flight": "1/5", 2024-09-17T23:02:34.178 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rgw_sync": "1/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_rocksdb": "4/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_backref": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_cache": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_cleaner": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_device": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_epm": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_journal": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_lba": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_odata": "0/5", 2024-09-17T23:02:34.179 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_omap": "0/5", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_onode": "0/5", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_t": "0/5", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_seastore_tm": "0/5", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_striper": "0/1", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_test": "0/5", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_throttle": "1/1", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_timer": "0/1", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_tp": "0/5", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "debug_trace": "1/5", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "device_failure_prediction_mode": "none", 2024-09-17T23:02:34.180 INFO:teuthology.orchestra.run.smithi005.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "err_to_graylog": "false", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "err_to_journald": "false", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "err_to_stderr": "true", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "err_to_syslog": "false", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "event_tracing": "false", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_addr": "0.0.0.0", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_http_port": "9926", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_prio_limit": "5", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_sort_metrics": "true", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "exporter_stats_period": "5", 2024-09-17T23:02:34.181 INFO:teuthology.orchestra.run.smithi005.stdout: "fake_statfs_for_testing": "0", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "fatal_signal_handlers": "true", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filer_max_purge_ops": "10", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filer_max_truncate_ops": "128", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_apply_finisher_threads": "1", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_blackhole": "false", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_btrfs_clone_range": "true", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_btrfs_snap": "true", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_caller_concurrency": "10", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_collect_device_partition_information": "true", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_commit_timeout": "600.000000", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_debug_inject_read_err": "false", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_debug_omap_check": "false", 2024-09-17T23:02:34.182 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_debug_verify_split": "false", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_dump_file": "", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fadvise": "true", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fail_eio": "true", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fd_cache_shards": "16", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fd_cache_size": "128", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fiemap": "false", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fiemap_threshold": "4096", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_inject_stall": "0", 2024-09-17T23:02:34.183 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_journal_parallel": "false", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_journal_trailing": "false", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_journal_writeahead": "false", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_kill_at": "0", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattrs": "0", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-17T23:02:34.184 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_xattr_value_size": "0", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_merge_threshold": "-10", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_odsync_write": "false", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_omap_backend": "rocksdb", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_omap_backend_path": "", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-17T23:02:34.185 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_op_thread_timeout": "60", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_op_threads": "2", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_punch_hole": "false", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_queue_max_ops": "50", 2024-09-17T23:02:34.186 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_seek_data_hole": "false", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_sloppy_crc": "false", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_splice": "false", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_split_multiple": "2", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_split_rand_factor": "20", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_update_to": "1000", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-17T23:02:34.187 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_enable": "true", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_xfs_extsize": "false", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "filestore_zfs_snap": "false", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "fio_dir": "/tmp/fio", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "4cb0491c-5273-43ce-9711-0f68bec58f2e", 2024-09-17T23:02:34.188 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_allow_other": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_atomic_o_trunc": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_big_writes": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_debug": "false", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_default_permissions": "false", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_disable_pagecache": "false", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_max_write": "0", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_multithreaded": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_require_active_mds": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_set_user_groups": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_splice_move": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_splice_read": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_splice_write": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-17T23:02:34.189 INFO:teuthology.orchestra.run.smithi005.stdout: "fuse_use_invalidate_cb": "true", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "gss_target_name": "ceph", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_file": "", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_inject_failure": "0", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_interval": "5", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "host": "smithi005", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-17T23:02:34.190 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "inject_early_sigterm": "false", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "jaeger_agent_port": "6799", 2024-09-17T23:02:34.191 INFO:teuthology.orchestra.run.smithi005.stdout: "jaeger_tracing_enable": "false", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_aio": "true", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_align_min_size": "65536", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_block_align": "true", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_block_size": "4096", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_dio": "true", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_discard": "false", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_force_aio": "false", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_ignore_corruption": "false", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_max_write_bytes": "10485760", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_max_write_entries": "100", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_replay_from": "0", 2024-09-17T23:02:34.192 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_write_header_frequency": "0", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "journal_zero_on_create": "false", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "journaler_prefetch_periods": "10", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "journaler_prezero_periods": "5", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "journaler_write_head_interval": "15", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "keyfile": "", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_backend": "rocksdb", 2024-09-17T23:02:34.193 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_default_stripe_size": "65536", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_fsck_on_mount": "false", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_max_bytes": "67108864", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_max_ops": "512", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_nid_prealloc": "1024", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_onode_map_size": "1024", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_sync_submit_transaction": "false", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "kstore_sync_transaction": "false", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "librados_thread_count": "2", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "lockdep": "false", 2024-09-17T23:02:34.194 INFO:teuthology.orchestra.run.smithi005.stdout: "lockdep_force_backtrace": "false", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_coarse_timestamps": "true", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_flush_on_exit": "false", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_graylog_host": "127.0.0.1", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_graylog_port": "12201", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_max_new": "1000", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_max_recent": "10000", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_stderr_prefix": "", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_stop_at_utilization": "0.970000", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_file": "true", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_graylog": "false", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_journald": "false", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_stderr": "false", 2024-09-17T23:02:34.195 INFO:teuthology.orchestra.run.smithi005.stdout: "log_to_syslog": "false", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "max_rotating_auth_attempts": "10", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_action_on_write_error": "1", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_alternate_name_max": "8192", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_asio_thread_count": "2", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_export_pin": "true", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_fragment_dirs": "true", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_fragment_interval": "5", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_interval": "10", 2024-09-17T23:02:34.196 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_max": "-1", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_max_until": "-1", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_merge_size": "50", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_midchunk": "0.300000", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_min_start": "0.200000", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_minchunk": "0.001000", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_mode": "0", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_need_max": "1.200000", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_need_min": "0.800000", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_overload_epochs": "2", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_split_bits": "3", 2024-09-17T23:02:34.197 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_split_size": "10000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_target_decay": "10.000000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_beacon_grace": "15.000000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_beacon_interval": "4.000000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_mid": "0.700000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_quiesce_delay": "0", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-17T23:02:34.198 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_release_free_interval": "10", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_reservation": "0.050000", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_trim_interval": "1", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cache_trim_threshold": "262144", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_client_prealloc_inos": "1000", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-17T23:02:34.199 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_connect_bootstrapping": "false", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_damage_table_max_entries": "10000", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_debug_auth_pins": "false", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_debug_frag": "false", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_debug_scatterstat": "false", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_debug_subtrees": "false", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_decay_halflife": "5.000000", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_default_dir_hash": "2", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_defer_session_stale": "true", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_deny_all_reconnect": "false", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dir_keys_per_op": "16384", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dir_max_commit_size": "10", 2024-09-17T23:02:34.200 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dir_max_entries": "0", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dir_prefetch": "true", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dump_cache_on_map": "false", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_early_reply": "true", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_enable_op_tracker": "true", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_enforce_unique_name": "true", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_export_ephemeral_random": "true", 2024-09-17T23:02:34.201 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_health_summarize_threshold": "10", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_health_dummy": "false", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-17T23:02:34.202 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_migrator_session_race": "false", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_join_fs": "", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_journal_format": "1", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_create_at": "0", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_export_at": "0", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_import_at": "0", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_journal_at": "0", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_journal_expire_at": "0", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_journal_replay_at": "0", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_link_at": "0", 2024-09-17T23:02:34.203 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_mdstable_at": "0", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_openc_at": "0", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_rename_at": "0", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_kill_shutdown_at": "0", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_event_large_threshold": "524288", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_events_per_segment": "1024", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_max_events": "-1", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_max_segments": "128", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_pause": "false", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_segment_size": "0", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-17T23:02:34.204 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_trim_threshold": "128", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_log_warn_factor": "2.000000", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_caps_per_client": "1048576", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_completed_flushes": "100000", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_completed_requests": "100000", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_export_size": "20971520", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_file_recover": "32", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_purge_files": "64", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_purge_ops": "8192", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_max_snaps_per_dir": "100", 2024-09-17T23:02:34.205 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_metrics_update_interval": "2", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_min_caps_per_client": "100", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_min_caps_working_set": "10000", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_numa_node": "-1", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_complaint_time": "30.000000", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_history_duration": "600", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_history_size": "20", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_history_slow_op_size": "20", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_op_log_threshold": "5", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_ping_grace": "15", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_ping_interval": "5", 2024-09-17T23:02:34.206 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_max_caps": "30000", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_recall_warning_threshold": "262144", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_replay_interval": "1.000000", 2024-09-17T23:02:34.207 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_root_ino_gid": "0", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_root_ino_uid": "0", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-17T23:02:34.208 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_shutdown_check": "0", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_skip_ino": "0", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_snap_max_uid": "4294967294", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_snap_min_uid": "0", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_snap_rstat": "false", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_standby_replay_damaged": "false", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_symlink_recovery": "true", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_thrash_exports": "0", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_thrash_fragments": "0", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_tick_interval": "5.000000", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_valgrind_exit": "false", 2024-09-17T23:02:34.209 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_verify_backtrace": "1", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_verify_scatter": "false", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mds_wipe_sessions": "false", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mempool_debug": "false", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "memstore_device_bytes": "1073741824", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "memstore_page_set": "false", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "memstore_page_size": "65536", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_client_bytes": "134217728", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_client_messages": "512", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-17T23:02:34.210 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_disabled_modules": "", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_enable_op_tracker": "true", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_max_pg_num_change": "128", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_mds_bytes": "134217728", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_mds_messages": "128", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_mon_bytes": "134217728", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_mon_messages": "128", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_op_history_duration": "600", 2024-09-17T23:02:34.211 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_op_history_size": "20", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_op_log_threshold": "5", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_osd_bytes": "536870912", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_osd_messages": "8192", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_pool": "true", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_standby_modules": "true", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_stats_period": "5", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_stats_threshold": "5", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_tick_period": "2", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-17T23:02:34.212 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_allow_pool_delete": "true", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_allow_pool_size_one": "true", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_auth_validate_all_caps": "true", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_bytes": "104857600", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_directed_command_retry": "5", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_hunt_parallel": "3", 2024-09-17T23:02:34.213 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_log_interval": "1.000000", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_ping_interval": "10.000000", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_client_target_rank": "-1", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_file_level": "debug", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_file": "true", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-17T23:02:34.214 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_journald": "false", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_compact_on_bootstrap": "false", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_compact_on_start": "false", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_compact_on_trim": "true", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_cpu_threads": "4", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_crush_min_required_version": "hammer", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_daemon_bytes": "419430400", 2024-09-17T23:02:34.215 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_data_avail_crit": "5", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_data_avail_warn": "5", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_data_size_warn": "16106127360", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_dump_json": "false", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_dump_transactions": "false", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_extra_checks": "false", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_no_require_reef": "false", 2024-09-17T23:02:34.216 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_no_require_squid": "false", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_down_mkfs_grace": "120", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_down_uptime_grace": "60", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_election_default_strategy": "1", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_election_timeout": "5.000000", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_elector_ping_divisor": "2", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_enable_op_tracker": "true", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_fake_pool_delete": "false", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_force_quorum_join": "false", 2024-09-17T23:02:34.217 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_globalid_prealloc": "10000", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_detail_to_clog": "false", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_log_update_period": "5", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_max_detail": "50", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_to_clog": "true", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_to_clog_interval": "600", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_host": "172.21.15.5,[v2:172.21.15.5:3301,v1:172.21.15.5:6790],172.21.15.152", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_host_override": "", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_initial_members": "", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-17T23:02:34.218 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_lease": "5.000000", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_log_full_interval": "50", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_log_max": "10000", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_log_max_summary": "50", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_log_epochs": "500", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_osd": "10000", 2024-09-17T23:02:34.219 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_pg_per_osd": "10000", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_pool_pg_num": "65536", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mds_force_trim_to": "0", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mds_skip_sanity": "false", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_memory_autotune": "true", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_memory_target": "2147483648", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_beacon_grace": "30", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_digest_period": "5", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_inactive_grace": "60", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-17T23:02:34.220 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_min_osdmap_epochs": "500", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_complaint_time": "30", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_history_duration": "600", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_history_size": "20", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_history_slow_op_size": "20", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_op_log_threshold": "5", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_auto_mark_in": "false", 2024-09-17T23:02:34.221 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_cache_size": "500", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_down_out_interval": "600", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_force_trim_to": "0", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-17T23:02:34.222 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_min_down_reporters": "2", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_report_timeout": "900", 2024-09-17T23:02:34.223 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_stuck_threshold": "60", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-17T23:02:34.224 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_probe_timeout": "2.000000", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_reweight_max_change": "0.050000", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_reweight_max_osds": "4", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_interval": "86400", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_max_keys": "100", 2024-09-17T23:02:34.225 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_scrub_timeout": "300", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_session_timeout": "300", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_smart_report_timeout": "5", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stat_smooth_intervals": "6", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stretch_pool_min_size": "2", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stretch_pool_size": "4", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_debug": "false", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_provider_kill_at": "0", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_requester_kill_at": "0", 2024-09-17T23:02:34.226 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_sync_timeout": "60.000000", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_target_pg_per_osd": "100", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_tick_interval": "5", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_timecheck_interval": "300.000000", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_use_min_delay_socket": "false", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_older_version_delay": "604800", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-17T23:02:34.227 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_misplaced": "false", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_older_version": "true", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "monmap": "", 2024-09-17T23:02:34.228 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "motr_tracing_enabled": "false", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_op_threads": "3", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_cm": "false", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_device_name": "", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_dscp": "96", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-17T23:02:34.229 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_local_gid": "", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_port_num": "1", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_sl": "3", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_support_srq": "true", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_rdma_type": "ib", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_async_reap_threshold": "5", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_before_connect": "false", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_ipv4": "true", 2024-09-17T23:02:34.230 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_ipv6": "false", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_msgr1": "true", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_msgr2": "true", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_port_max": "7568", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_port_min": "6800", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_retry_count": "3", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_bind_retry_delay": "5", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_client": "false", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_mds": "false", 2024-09-17T23:02:34.231 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_mgr": "false", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_mon": "false", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_blackhole_osd": "false", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_client_mode": "crc secure", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_cluster_mode": "crc secure", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_cluster_type": "", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_compress_secure": "false", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_connection_idle_timeout": "900", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_connection_ready_timeout": "10", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_crc_data": "true", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_crc_header": "true", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_bad_msg": "false", 2024-09-17T23:02:34.232 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_bug": "true", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_old_message": "true", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_skipped_message": "false", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_coremask": "0xF", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_enable_tso": "true", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_hugepages": "", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-17T23:02:34.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_lro": "true", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_memory_channel": "4", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_pmd": "", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_port_id": "0", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_dump_on_send": "false", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_initial_backoff": "0.200000", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_delay_max": "1.000000", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_delay_type": "", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-17T23:02:34.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_network_congestion": "0", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_inject_socket_failures": "5000", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_learn_addr_from_peer": "true", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_max_accept_failures": "4", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_max_backoff": "15.000000", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_mon_client_mode": "secure crc", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_mon_service_mode": "secure crc", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_osd_compress_min_size": "1024", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_osd_compress_mode": "none", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_pq_min_cost": "65536", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_public_type": "", 2024-09-17T23:02:34.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_service_mode": "crc secure", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_tcp_listen_backlog": "512", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_tcp_nodelay": "true", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_tcp_rcvbuf": "0", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "ms_type": "async+posix", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "no_config_file": "false", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_completion_locks_per_session": "32", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_inflight_ops": "1024", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-17T23:02:34.236 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_tick_interval": "5.000000", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "objecter_timeout": "10.000000", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "objectstore_blackhole": "false", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "openssl_engine_opts": "", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_delay_time": "5.000000", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_hist_halflife": "1000", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_max_low_ops": "2", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_max_ops": "4", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_agent_slop": "0.020000", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-17T23:02:34.237 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_asio_thread_count": "2", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_async_recovery_min_cost": "100", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backfill_scan_max": "512", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backfill_scan_min": "64", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backoff_on_degraded": "false", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backoff_on_peering": "false", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_backoff_on_unfound": "true", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_beacon_report_interval": "300", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bench_duration": "30", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bench_max_block_size": "67108864", 2024-09-17T23:02:34.238 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_blkin_trace_all": "false", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_check_for_log_corruption": "false", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_class_update_on_start": "true", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_client_message_cap": "256", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_client_message_size_cap": "524288000", 2024-09-17T23:02:34.239 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_client_op_priority": "63", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_client_watch_timeout": "30", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_command_max_records": "256", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_compact_on_start": "false", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_crush_update_on_start": "true", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_crush_update_weight_set": "true", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-17T23:02:34.240 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_feed_pullee": "-1", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_misdirected_ops": "false", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_no_acting_change": "false", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_no_purge_strays": "false", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_op_order": "false", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-17T23:02:34.241 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_shutdown": "false", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_trim_objects": "false", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_verify_snaps": "false", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_keys": "1024", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-17T23:02:34.242 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_stride": "524288", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_default_notify_timeout": "30", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_delete_sleep": "0.000000", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_discard_disconnected_ops": "true", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_enable_op_tracker": "true", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-17T23:02:34.243 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_info": "true", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_shutdown": "true", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_function_tracing": "false", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_grace": "20", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_interval": "6", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-17T23:02:34.244 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_min_peers": "10", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_min_size": "2000", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_stale": "600", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_hit_set_max_size": "100000", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_hit_set_min_size": "1000", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_journal_size": "5120", 2024-09-17T23:02:34.245 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_kill_backfill_at": "0", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_cache_size": "50", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_dedup": "true", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_message_max": "40", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_map_share_max_epochs": "40", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_attr_name_len": "100", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_attr_size": "0", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_backfills": "1", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_markdown_count": "5", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_markdown_period": "600", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_object_name_len": "2048", 2024-09-17T23:02:34.246 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_object_namespace_len": "256", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_object_size": "134217728", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_pg_blocked_by": "16", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_pg_log_entries": "10000", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_pgls": "1024", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_push_cost": "8388608", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_push_objects": "10", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_scrubs": "3", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_trimming_pgs": "2", 2024-09-17T23:02:34.247 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_write_op_reply_len": "64", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_max_write_size": "90", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_profile": "balanced", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-17T23:02:34.248 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_base": "805306368", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_cache_min": "134217728", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-17T23:02:34.249 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_target": "4294967296", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_target_autotune": "false", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_min_pg_log_entries": "250", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_min_recovery_priority": "0", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_report_interval": "5", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_num_cache_shards": "32", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_num_op_tracker_shard": "32", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_numa_auto_affinity": "true", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_numa_node": "-1", 2024-09-17T23:02:34.250 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_numa_prefer_iface": "true", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_objecter_finishers": "1", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_objectstore": "bluestore", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_objectstore_fuse": "false", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_objectstore_tracing": "false", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_complaint_time": "30.000000", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_history_duration": "600", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_history_size": "20", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_history_slow_op_size": "20", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_log_threshold": "5", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_shards": "0", 2024-09-17T23:02:34.251 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_shards_hdd": "5", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_shards_ssd": "8", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_pq_min_cost": "65536", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_queue_cut_off": "high", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_op_thread_timeout": "15", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_open_classes_on_start": "true", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_os_flags": "0", 2024-09-17T23:02:34.252 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_peering_op_priority": "255", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_delete_cost": "1048576", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_delete_priority": "5", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_log_trim_max": "10000", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_log_trim_min": "100", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-17T23:02:34.253 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_crimson": "false", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-17T23:02:34.254 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_flags": "0", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_min_size": "0", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_pg_num": "32", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_pgp_num": "0", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_read_ratio": "70", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_size": "2", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_default_type": "replicated", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_push_per_object_cost": "1000", 2024-09-17T23:02:34.255 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recover_clone_overlap": "true", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_cost": "20971520", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_active": "0", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_max_single_start": "1", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_op_priority": "3", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-17T23:02:34.256 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_priority": "5", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_sleep": "0.000000", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_repair_during_recovery": "false", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_requested_scrub_priority": "120", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_auto_repair": "false", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-17T23:02:34.257 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_begin_hour": "0", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_begin_week_day": "0", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_chunk_max": "25", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_chunk_min": "5", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_cost": "52428800", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_during_recovery": "false", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_end_hour": "0", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_end_week_day": "0", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_event_cost": "4096", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-17T23:02:34.258 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_invalid_stats": "true", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_max_preemptions": "5", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_priority": "5", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_scrub_sleep": "0.000000", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_skip_data_digest": "false", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_smart_report_timeout": "5", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_cost": "1048576", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_priority": "5", 2024-09-17T23:02:34.259 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_target_transaction_size": "30", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-17T23:02:34.260 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_tracing": "false", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_use_stale_snap": "false", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "osdc_blkin_trace_all": "false", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_kill_at": "0", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_max_join_drift": "10", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_min": "500", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_min_wait": "0.050000", 2024-09-17T23:02:34.261 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_propose_interval": "1.000000", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_service_trim_max": "500", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_service_trim_min": "250", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_stash_full_interval": "25", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_trim_max": "500", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "paxos_trim_min": "250", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "perf": "true", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "-", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrv": "", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "public_bind_addr": "-", 2024-09-17T23:02:34.262 INFO:teuthology.orchestra.run.smithi005.stdout: "public_network": "", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "public_network_interface": "", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "qat_compressor_busy_polling": "false", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "qat_compressor_enabled": "false", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "qat_compressor_session_max_number": "256", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rados_mon_op_timeout": "0", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rados_osd_op_timeout": "0", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rados_tracing": "false", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_atime_update_interval": "60", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_balance_parent_reads": "false", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_balance_snap_reads": "false", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_blkin_trace_all": "false", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-17T23:02:34.263 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache": "true", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_policy": "writearound", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_size": "33554432", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_clone_copy_on_read": "false", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_compression_hint": "none", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_concurrent_management_ops": "10", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-17T23:02:34.264 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_clone_format": "auto", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_data_pool": "", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_features": "61", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_format": "2", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_map_options": "", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_order": "22", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_pool": "rbd", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_stripe_count": "0", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_default_stripe_unit": "0", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-17T23:02:34.265 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_enable_alloc_hint": "true", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_io_scheduler": "simple", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_order": "24", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_pool": "", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_journal_splay_width": "4", 2024-09-17T23:02:34.266 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_localize_parent_reads": "false", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_localize_snap_reads": "false", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-17T23:02:34.267 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-17T23:02:34.268 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_mtime_update_interval": "60", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_non_blocking_aio": "true", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_op_thread_timeout": "60", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_op_threads": "1", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_parent_cache_enabled": "false", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_plugins": "", 2024-09-17T23:02:34.269 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_bps_burst": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_bps_limit": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_exclude_ops": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_iops_burst": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_iops_limit": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-17T23:02:34.270 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_read_from_replica_policy": "default", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_skip_partial_discard": "true", 2024-09-17T23:02:34.271 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_tracing": "false", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_validate_names": "true", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd_validate_pool": "true", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "restapi_base_url": "", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "restapi_log_level": "", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_acl_grants_max_num": "100", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_admin_entry": "admin", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_backend_store": "rados", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_barbican_url": "", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_beast_enable_async": "true", 2024-09-17T23:02:34.272 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_counters_cache": "false", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cache_enabled": "true", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cache_expiry_interval": "900", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cache_lru_size": "25000", 2024-09-17T23:02:34.273 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_config_store": "rados", 2024-09-17T23:02:34.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_content_length_compat": "false", 2024-09-17T23:02:34.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_copy_obj_progress": "true", 2024-09-17T23:02:34.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-17T23:02:34.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cors_rules_max_num": "100", 2024-09-17T23:02:34.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_cross_domain_policy": "", 2024-09-17T23:02:34.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-17T23:02:34.274 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_addr": "", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_password": "", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_kmip_username": "", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_require_ssl": "true", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-17T23:02:34.275 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_addr": "", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_auth": "token", 2024-09-17T23:02:34.276 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_namespace": "", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_prefix": "", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_token_file": "", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_buffersize": "524288", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_low_speed_time": "300", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-17T23:02:34.277 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_d4n_port": "6379", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_log_changes_size": "1000", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_log_num_shards": "128", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-17T23:02:34.278 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_log_window": "30", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-17T23:02:34.279 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dns_name": "", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dns_s3website_name": "", 2024-09-17T23:02:34.280 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_dynamic_resharding": "true", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_gc_threads": "true", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_lc_threads": "true", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_ops_log": "false", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_quota_threads": "true", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_static_website": "false", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enable_usage_log": "false", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_enforce_swift_acls": "true", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_exit_timeout_secs": "120", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_expose_bucket": "false", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_extended_http_attrs": "", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_filter": "none", 2024-09-17T23:02:34.281 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_frontends": "beast port=7480", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_deferred": "50", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_objs": "32", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_gc_processor_period": "3600", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-17T23:02:34.282 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_init_timeout": "300", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_kafka_connection_idle": "300", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_domain": "", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_password": "", 2024-09-17T23:02:34.283 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_password_path": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_project": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_tenant": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_token": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_token_path": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_admin_user": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_api_version": "2", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_domain": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_password": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_project": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_barbican_user": "", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-17T23:02:34.284 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_url": "", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_debug_interval": "-1", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_lock_max_time": "90", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_max_objs": "32", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_max_rules": "1000", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_max_worker": "3", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lc_thread_delay": "0", 2024-09-17T23:02:34.285 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_dnattr": "uid", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_searchfilter": "", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ldap_uri": "", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_log_http_headers": "", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_log_object_name_utc": "false", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-17T23:02:34.286 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_attr_name_len": "0", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_attr_size": "0", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_chunk_size": "4194304", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_listing_results": "1000", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_notify_retries": "10", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_put_param_size": "1048576", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_put_size": "5368709120", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_max_slo_entries": "1000", 2024-09-17T23:02:34.287 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_md_log_max_shards": "64", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_mp_lock_max_time": "600", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-17T23:02:34.288 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_max_gc": "300", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_num_async_rados_threads": "32", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_num_control_oids": "8", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_numa_node": "-1", 2024-09-17T23:02:34.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_objexp_chunk_size": "100", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_objexp_gc_interval": "600", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_op_thread_timeout": "600", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_op_tracing": "false", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_opa_token": "", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_opa_url": "", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_opa_verify_ssl": "true", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-17T23:02:34.290 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ops_log_rados": "false", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_ops_log_socket_path": "", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_period_push_interval": "2.000000", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_posix_cache_lanes": "3", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-17T23:02:34.291 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_posix_cache_partitions": "3", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_print_continue": "true", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_rados_tracing": "false", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_realm": "", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_realm_id": "", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-17T23:02:34.292 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_region": "", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_request_uri": "", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_batch_size": "64", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_max_aio": "128", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_num_logs": "16", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_reshard_thread_interval": "600", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_resolve_cname": "false", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-17T23:02:34.293 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_run_sync_thread": "true", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_scheduler_type": "throttler", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_script_uri": "", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_service_provider_name": "", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-17T23:02:34.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_client_id": "", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_client_secret": "", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_entry": "sts", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_key": "sts", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_min_session_duration": "900", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sts_token_introspection_url": "", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_account_in_url": "false", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_auth_entry": "auth", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_auth_url": "", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_custom_header": "", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_need_stats": "true", 2024-09-17T23:02:34.295 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_tenant_name": "", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_token_expiration": "86400", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_url": "", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_url_prefix": "swift", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_lease_period": "120", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-17T23:02:34.296 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_thread_pool_size": "512", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_comment": "", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_createby": "", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_encoding": "", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_flag": "false", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-17T23:02:34.297 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_origin": "", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_torrent_tracker": "", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_trust_forwarded_https": "false", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_usage_max_shards": "32", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_usage_max_user_shards": "1", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_use_opa_authz": "false", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_counters_cache": "false", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-17T23:02:34.298 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_max_buckets": "1000", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_policies_max_num": "100", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_user_unique_email": "true", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_verify_ssl": "true", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zone": "", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zone_id": "", 2024-09-17T23:02:34.299 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zonegroup": "", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zonegroup_id": "", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rgwlc_auto_session_clear": "true", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_block_size": "4096", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_size": "536870912", 2024-09-17T23:02:34.300 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_index_type": "binary_search", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_partition_filters": "false", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_perf": "false", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-17T23:02:34.301 INFO:teuthology.orchestra.run.smithi005.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "run_dir": "/var/run/ceph", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_block_create": "true", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_cache_lru_size": "67108864", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_default_max_object_size": "16777216", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_device_size": "53687091200", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_full_integrity_check": "false", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_journal_batch_capacity": "16", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-17T23:02:34.302 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_main_device_type": "SSD", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "seastore_segment_size": "67108864", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "set_keepcaps": "false", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "setgroup": "", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "setuser": "", 2024-09-17T23:02:34.303 INFO:teuthology.orchestra.run.smithi005.stdout: "setuser_match_path": "", 2024-09-17T23:02:34.304 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-17T23:02:34.304 INFO:teuthology.orchestra.run.smithi005.stdout: "thp": "false", 2024-09-17T23:02:34.304 INFO:teuthology.orchestra.run.smithi005.stdout: "threadpool_default_timeout": "60", 2024-09-17T23:02:34.304 INFO:teuthology.orchestra.run.smithi005.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-17T23:02:34.304 INFO:teuthology.orchestra.run.smithi005.stdout: "throttler_perf_counter": "true" 2024-09-17T23:02:34.304 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:34.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-17T23:02:34.423 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a: {} 2024-09-17T23:02:34.423 INFO:teuthology.orchestra.run.smithi005.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T23:02:34.432 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b: {} 2024-09-17T23:02:34.432 INFO:teuthology.orchestra.run.smithi005.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T23:02:34.441 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c: {} 2024-09-17T23:02:34.441 INFO:teuthology.orchestra.run.smithi005.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T23:02:34.451 DEBUG:teuthology.orchestra.run.smithi005:> type ceph-objectstore-tool 2024-09-17T23:02:34.466 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T23:02:34.466 DEBUG:teuthology.orchestra.run.smithi152:> type ceph-objectstore-tool 2024-09-17T23:02:34.485 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T23:02:34.485 INFO:teuthology.run_tasks:Running task workunit... 2024-09-17T23:02:34.498 INFO:tasks.workunit:Pulling workunits from ref b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 2024-09-17T23:02:34.498 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-17T23:02:34.499 DEBUG:teuthology.orchestra.run.smithi005:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-17T23:02:34.499 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-17T23:02:34.499 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T23:02:34.499 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:02:34.499 INFO:tasks.thrashosds.thrasher:Killing osd 1, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T23:02:34.499 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T23:02:34.500 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:02:34.500 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-17T23:02:34.500 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-17T23:02:34.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:02:34.500 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-17T23:02:34.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:34.501 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-17T23:02:34.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:02:34.508 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:34.505+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:34.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T23:02:34.523 INFO:teuthology.orchestra.run.smithi005.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-17T23:02:34.524 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-17T23:02:34.533 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T23:02:34.533 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.1 2024-09-17T23:02:34.534 INFO:tasks.thrashosds.thrasher:remote for osd 1 is ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:02:34.534 DEBUG:teuthology.orchestra.run.smithi005:> type ceph-objectstore-tool 2024-09-17T23:02:34.590 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-17T23:02:34.590 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-17T23:02:34.594 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T23:02:34.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op list-pgs 2024-09-17T23:02:34.602 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:34.600+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:34.626 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:34.626 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:34.626 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:34.626 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:34.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:34.641 INFO:tasks.workunit:timeout=3h 2024-09-17T23:02:34.642 INFO:tasks.workunit:cleanup=True 2024-09-17T23:02:34.642 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 2024-09-17T23:02:34.653 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:34.653 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:34.670 INFO:tasks.workunit.client.0.smithi005.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-17T23:02:34.703 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:34.700+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:34.761 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:34.761 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:34.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:34.803 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:34.801+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:34.888 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:34.889 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:34.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:34.904 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:34.901+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:35.005 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:35.002+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:35.014 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:35.014 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:35.025 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:35.105 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:35.103+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:35.137 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:35.137 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:35.137 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:35.137 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:35.137 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:35.147 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:35.206 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:02:35.206 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:35.204+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:35.304 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:35.304 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:35.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:35.304 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:02:35.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.304 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:02:35.304 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:35.304 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 9.0632803410000005, 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:02:35.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:02:35.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:35.308 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:35.309 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:35.307+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:35.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:35.410 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:35.408+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:35.425 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:35.426 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:35.426 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:35.434 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:35.511 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:35.509+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:35.542 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:35.542 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:35.542 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:35.542 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:35.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:35.612 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:35.610+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:35.698 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:35.699 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:35.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:35.699 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:02:35.699 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:35.707 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:35.751 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:35.749+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:35.815 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:35.812+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:35.822 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:35.822 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:35.822 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:35.823 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:35.831 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:35.915 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:35.913+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:35.977 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:35.977 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:35.978 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:35.978 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:35.978 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:35.986 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:02:36.027 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:36.025+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:36.094 INFO:teuthology.orchestra.run.smithi005.stdout:2.6 2024-09-17T23:02:36.094 INFO:teuthology.orchestra.run.smithi005.stdout:2.4 2024-09-17T23:02:36.094 INFO:teuthology.orchestra.run.smithi005.stdout:2.2 2024-09-17T23:02:36.095 INFO:teuthology.orchestra.run.smithi005.stdout:2.0 2024-09-17T23:02:36.117 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:36.114+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:36.129 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:02:36.129 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:36.137 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:02:36.217 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:36.215+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:36.283 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:36.283 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:36.283 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:36.283 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:36.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:02:36.334 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:36.332+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:36.395 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:36.395 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:36.395 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:36.395 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:36.395 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:36.403 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:02:36.420 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:36.417+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:36.520 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:36.518+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:36.548 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:36.548 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:36.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:36.548 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.309588899, 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:36.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:36.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:02:36.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:02:36.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.555 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.305847615999999, 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:02:36.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:02:36.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.300985000000001, 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:02:36.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:36.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:02:36.563 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.300553011, 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:36.564 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:36.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:36.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 9.3080869360000005, 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:36.568 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:02:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:02:36.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 9.3049411509999995, 2024-09-17T23:02:36.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:36.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.579 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 8.3022120109999999, 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:36.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:02:36.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:02:36.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:02:36.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:02:36.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.586 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 8.2987891850000004, 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:36.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:36.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:02:36.590 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.591 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.591 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.591 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:36.591 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:36.591 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:36.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:02:36.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op export --pgid 2.0 --file /var/log/ceph/exp.2.0.1 2024-09-17T23:02:36.633 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:36.631+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:36.721 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:36.720+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:36.734 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:36.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:36.734 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:36.734 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:36.743 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:02:36.823 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:36.821+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:36.846 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:36.846 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:36.846 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:36.847 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:36.847 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:36.856 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:02:36.924 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:36.922+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:36.959 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:36.959 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:36.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:36.959 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:02:36.960 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:36.968 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:02:37.052 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:37.050+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:37.112 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:37.112 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:37.112 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:37.120 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:02:37.161 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:37.159+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:37.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:02:37.264 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:37.264 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:37.264 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:37.264 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:37.264 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:37.266 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:37.264+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:37.272 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:02:37.328 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:37.326+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:37.379 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:37.379 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 16.163824506000001, 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.188649542, 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.380 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212078+0000", 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.669e-06 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212092+0000", 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4959e-05 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212105+0000", 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2283000000000001e-05 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212114+0000", 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8990000000000007e-06 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212177+0000", 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3533000000000003e-05 2024-09-17T23:02:37.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212187+0000", 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4790000000000002e-06 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399184+0000", 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.18699711599999999 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.384 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399382+0000", 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019809299999999999 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399604+0000", 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00022205 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400259+0000", 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065476499999999997 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.385 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400634+0000", 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00037537600000000002 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400675+0000", 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1291999999999997e-05 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400725+0000", 2024-09-17T23:02:37.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0028000000000003e-05 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:21 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 65536~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.955604214999999, 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076785070000000002, 2024-09-17T23:02:37.387 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 21 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420297+0000", 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.54e-07 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.389 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420377+0000", 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9809999999999997e-05 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420387+0000", 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0026e-05 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420391+0000", 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5510000000000001e-06 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.390 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420833+0000", 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044210300000000001 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420887+0000", 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3324e-05 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420973+0000", 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6428999999999995e-05 2024-09-17T23:02:37.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422150+0000", 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011773039999999999 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427781+0000", 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056303120000000002 2024-09-17T23:02:37.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427900+0000", 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000118769 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427975+0000", 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5124999999999996e-05 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:22 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.955495373, 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0077273339999999998, 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 22 2024-09-17T23:02:37.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.395 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420406+0000", 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4000000000000001e-07 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420410+0000", 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5789999999999997e-06 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420417+0000", 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8900000000000001e-06 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420423+0000", 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7679999999999997e-06 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421317+0000", 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00089395000000000002 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421370+0000", 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3492999999999998e-05 2024-09-17T23:02:37.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421455+0000", 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4351000000000006e-05 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422372+0000", 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091742899999999999 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.398 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427997+0000", 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056245289999999996 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428104+0000", 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106944 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428132+0000", 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8761000000000001e-05 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.399 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.757876337999999, 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063598999999999999, 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.400 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 110 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.401 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618025+0000", 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8400000000000004e-07 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618029+0000", 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1489999999999996e-06 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618037+0000", 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0979999999999994e-06 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.402 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618047+0000", 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0247e-05 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622380+0000", 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043329900000000001 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622456+0000", 2024-09-17T23:02:37.403 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6040999999999999e-05 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622592+0000", 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013632600000000001 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624289+0000", 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696737 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624301+0000", 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2099000000000001e-05 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624346+0000", 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4634e-05 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624384+0000", 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7994999999999998e-05 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.405 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.757826567, 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0064380779999999999, 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 111 2024-09-17T23:02:37.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.407 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9699999999999996e-07 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618078+0000", 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.811e-06 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618092+0000", 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.413e-05 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.408 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618103+0000", 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0232e-05 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623161+0000", 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050586880000000004 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623220+0000", 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8449000000000002e-05 2024-09-17T23:02:37.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623293+0000", 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3139000000000006e-05 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624390+0000", 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00109734 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624455+0000", 2024-09-17T23:02:37.410 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4478000000000002e-05 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624489+0000", 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3853000000000003e-05 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624512+0000", 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3360999999999999e-05 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.757780491, 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0074594789999999998, 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 112 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.412 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618121+0000", 2024-09-17T23:02:37.413 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7000000000000004e-07 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618204+0000", 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3512999999999998e-05 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618213+0000", 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2359999999999993e-06 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618219+0000", 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1770000000000003e-06 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623528+0000", 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053089269999999997 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623604+0000", 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5462000000000004e-05 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.415 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623734+0000", 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013053399999999999 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625477+0000", 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001742653 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625492+0000", 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4825e-05 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.416 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625539+0000", 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7033999999999997e-05 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625579+0000", 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0448000000000003e-05 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.417 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.757668449000001, 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0082098180000000007, 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 113 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618233+0000", 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1200000000000003e-07 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618240+0000", 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2989999999999999e-06 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618247+0000", 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.542e-06 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618252+0000", 2024-09-17T23:02:37.420 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8010000000000003e-06 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624556+0000", 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063039050000000003 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624641+0000", 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4456999999999995e-05 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.421 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624763+0000", 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000122917 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625627+0000", 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086396699999999999 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626341+0000", 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00071333799999999999 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.422 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626391+0000", 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0192999999999999e-05 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626442+0000", 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0787e-05 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.423 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.757640415999999, 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0087386709999999999, 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.424 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 114 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.425 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3799999999999998e-07 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618263+0000", 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8820000000000001e-06 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618267+0000", 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0840000000000002e-06 2024-09-17T23:02:37.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618271+0000", 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8449999999999996e-06 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625074+0000", 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068027599999999997 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.427 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625121+0000", 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6805999999999999e-05 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625206+0000", 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5538999999999995e-05 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626903+0000", 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696454 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626916+0000", 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3634e-05 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626962+0000", 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5357e-05 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626999+0000", 2024-09-17T23:02:37.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6971999999999998e-05 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.757621418999999, 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093097030000000008, 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.430 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 115 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:37.431 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.27e-07 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618326+0000", 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6261999999999999e-05 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618331+0000", 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0889999999999999e-06 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618334+0000", 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.23e-06 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625664+0000", 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0073300989999999996 2024-09-17T23:02:37.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625739+0000", 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5535000000000001e-05 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625882+0000", 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014275299999999999 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627033+0000", 2024-09-17T23:02:37.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001151116 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627506+0000", 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047273299999999997 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627550+0000", 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4189e-05 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627589+0000", 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.837e-05 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.757557839, 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093607020000000003, 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.436 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 116 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.437 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9299999999999998e-07 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618347+0000", 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.664e-06 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618351+0000", 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3359999999999997e-06 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618354+0000", 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8540000000000001e-06 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626489+0000", 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0081350580000000006 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626538+0000", 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9490999999999998e-05 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626617+0000", 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8404000000000004e-05 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627611+0000", 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00099458599999999999 2024-09-17T23:02:37.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627624+0000", 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2598e-05 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627668+0000", 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3501000000000002e-05 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627703+0000", 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5716999999999997e-05 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.757541571000001, 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.009520489, 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.442 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 117 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:37.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2399999999999999e-07 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618361+0000", 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1059999999999998e-06 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.444 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618365+0000", 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6150000000000001e-06 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618367+0000", 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6790000000000001e-06 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627063+0000", 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0086957619999999992 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627146+0000", 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2879000000000004e-05 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627287+0000", 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014122700000000001 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627757+0000", 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000470066 2024-09-17T23:02:37.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627820+0000", 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.279e-05 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627856+0000", 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5463999999999998e-05 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627879+0000", 2024-09-17T23:02:37.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3677e-05 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.352484114999999, 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0075600570000000002, 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.448 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 137 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023417+0000", 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8599999999999998e-07 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023466+0000", 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8794000000000001e-05 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023474+0000", 2024-09-17T23:02:37.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7139999999999999e-06 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023480+0000", 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8019999999999997e-06 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027360+0000", 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038796270000000001 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027440+0000", 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0753000000000004e-05 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027519+0000", 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8203999999999999e-05 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028755+0000", 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012362790000000001 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030928+0000", 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021728120000000001 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030954+0000", 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5910000000000001e-05 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030976+0000", 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2676000000000001e-05 2024-09-17T23:02:37.453 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.352403027999999, 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076214569999999999, 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.454 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 138 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023498+0000", 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8800000000000002e-07 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023503+0000", 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3669999999999996e-06 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023510+0000", 2024-09-17T23:02:37.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7889999999999997e-06 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023519+0000", 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.098e-06 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028869+0000", 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053500609999999997 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028946+0000", 2024-09-17T23:02:37.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6508999999999995e-05 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029084+0000", 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013776700000000001 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030981+0000", 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001897971 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031025+0000", 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3883e-05 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031079+0000", 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3325999999999997e-05 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031119+0000", 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0098000000000001e-05 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.459 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.352372016, 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076808450000000004, 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 139 2024-09-17T23:02:37.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023529+0000", 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023532+0000", 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.456e-06 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023539+0000", 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6540000000000002e-06 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023544+0000", 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1529999999999996e-06 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029398+0000", 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0058541829999999998 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029444+0000", 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5605999999999997e-05 2024-09-17T23:02:37.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029521+0000", 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6689999999999999e-05 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031156+0000", 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0016352700000000001 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031163+0000", 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9269999999999999e-06 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031187+0000", 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4235000000000001e-05 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031209+0000", 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.213e-05 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.465 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.352344855, 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0078442649999999996, 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.466 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 140 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0200000000000002e-07 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023622+0000", 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6181999999999998e-05 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023631+0000", 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5750000000000001e-06 2024-09-17T23:02:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023638+0000", 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4630000000000004e-06 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029770+0000", 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0061317089999999999 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029845+0000", 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5439999999999996e-05 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029968+0000", 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012251800000000001 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031244+0000", 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012764359999999999 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031339+0000", 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4217999999999998e-05 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031380+0000", 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1258999999999999e-05 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031400+0000", 2024-09-17T23:02:37.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9962999999999998e-05 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.352248271000001, 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0085476930000000003, 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.472 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 141 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023653+0000", 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6499999999999999e-07 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023657+0000", 2024-09-17T23:02:37.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0400000000000003e-06 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023664+0000", 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1790000000000002e-06 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023669+0000", 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3029999999999999e-06 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030600+0000", 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069304589999999999 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030647+0000", 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7354000000000001e-05 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030718+0000", 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1116000000000001e-05 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031458+0000", 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00074007599999999999 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032158+0000", 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069986799999999997 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032181+0000", 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2832000000000001e-05 2024-09-17T23:02:37.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032200+0000", 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8800999999999998e-05 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.843538702, 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068810570000000003, 2024-09-17T23:02:37.478 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 156 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8999999999999997e-07 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532365+0000", 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0079999999999998e-06 2024-09-17T23:02:37.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532371+0000", 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1369999999999999e-06 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532378+0000", 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.443e-06 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533797+0000", 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0014196530000000001 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533838+0000", 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0629e-05 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533916+0000", 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8107000000000003e-05 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535288+0000", 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001372123 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539185+0000", 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038971600000000002 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539219+0000", 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3905000000000001e-05 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539243+0000", 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3402000000000001e-05 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.843514967000001, 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069027610000000003, 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.484 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 157 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532386+0000", 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5999999999999999e-07 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532393+0000", 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8929999999999999e-06 2024-09-17T23:02:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532398+0000", 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6869999999999999e-06 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532407+0000", 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8270000000000004e-06 2024-09-17T23:02:37.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534365+0000", 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0019577510000000002 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534418+0000", 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2936000000000003e-05 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534482+0000", 2024-09-17T23:02:37.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4212000000000001e-05 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535659+0000", 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011769230000000001 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539247+0000", 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0035881020000000001 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539269+0000", 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1807e-05 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539288+0000", 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9162999999999999e-05 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.843481727, 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.006929943, 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 158 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5300000000000004e-07 2024-09-17T23:02:37.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532590+0000", 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017035600000000001 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532598+0000", 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4009999999999997e-06 2024-09-17T23:02:37.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532604+0000", 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9209999999999997e-06 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534755+0000", 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021515750000000002 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534795+0000", 2024-09-17T23:02:37.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9229e-05 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534866+0000", 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1607999999999996e-05 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535934+0000", 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001068049 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539293+0000", 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033591300000000001 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539328+0000", 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4715999999999998e-05 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539349+0000", 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0404999999999999e-05 2024-09-17T23:02:37.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.843285807000001, 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0067798900000000002, 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:37.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 159 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:37.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1999999999999999e-07 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532619+0000", 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6859999999999999e-06 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:37.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532626+0000", 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3810000000000001e-06 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532632+0000", 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7049999999999996e-06 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535305+0000", 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0026735190000000001 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535345+0000", 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9313000000000001e-05 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535408+0000", 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3072999999999997e-05 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.536170+0000", 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076224300000000001 2024-09-17T23:02:37.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539352+0000", 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0031817310000000001 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539376+0000", 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3743e-05 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:37.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539394+0000", 2024-09-17T23:02:37.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8876e-05 2024-09-17T23:02:37.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.503 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:37.503 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:37.503 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:37.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:37.505 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:37.502+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:37.605 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:37.603+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:37.611 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:37.612 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:37.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:37.706 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:37.704+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:37.727 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:37.727 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:37.736 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:37.820 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:37.818+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:37.885 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:37.885 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:37.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:37.908 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:37.906+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:38.009 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:38.007+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:38.041 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:38.041 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:38.041 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:38.041 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:38.049 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:38.065 INFO:teuthology.orchestra.run.smithi005.stderr:Exporting 2.0 info 2.0( empty local-lis/les=18/19 n=0 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-17T23:02:38.067 INFO:teuthology.orchestra.run.smithi005.stderr:Export successful 2024-09-17T23:02:38.111 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:38.109+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:38.171 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:38.172 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:38.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:38.212 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:02:38.212 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:38.210+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:38.290 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 12.049608014, 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:02:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:38.295 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:38.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:38.342 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:38.340+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:38.406 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:38.407 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:38.407 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:38.407 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:38.413 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:38.411+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:38.415 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:38.514 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:38.512+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:38.562 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:38.562 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:38.562 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:38.562 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:38.562 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:38.571 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:38.590 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --force --op remove --pgid 2.0 2024-09-17T23:02:38.615 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:38.613+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:38.716 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:38.714+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:38.737 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:38.737 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:38.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:38.738 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:02:38.738 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:38.746 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:38.817 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:38.815+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:38.862 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:38.863 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:38.863 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:38.863 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:38.872 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:38.956 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:38.954+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:39.016 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:39.016 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:39.016 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:39.017 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:39.017 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:39.019 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:39.017+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:39.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:02:39.120 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:39.118+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:39.172 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:39.172 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:39.172 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:39.172 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:02:39.173 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:39.181 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:02:39.225 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:39.223+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:39.285 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:39.285 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:39.286 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:39.294 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:02:39.334 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:39.332+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:39.423 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:39.421+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:39.437 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:39.437 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:39.437 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:39.437 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:39.438 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:39.446 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:02:39.524 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:39.521+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 13.352232061, 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:02:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:39.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:02:39.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:02:39.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 13.348490778, 2024-09-17T23:02:39.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:39.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:02:39.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 13.343628162, 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.603 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:02:39.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:39.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 13.343196173000001, 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:39.607 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:02:39.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:02:39.611 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 12.350730098, 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:02:39.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:02:39.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:02:39.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:39.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:02:39.618 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 12.347584313, 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:02:39.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:02:39.622 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 11.344855172999999, 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:39.623 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:39.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:02:39.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:39.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:02:39.629 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 11.341432347, 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:39.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:02:39.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:02:39.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:39.634 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:39.635 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:39.636 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:02:39.637 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:39.632+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:39.640 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:39.640 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:39.657 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:39.657 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:39.674 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:39.675 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:39.693 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:39.693 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:39.710 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:39.710 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:39.727 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:39.727 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:39.731 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:39.731 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:39.736 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:39.734+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:39.742 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:39.742 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:39.751 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:02:39.837 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:39.835+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:39.895 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:39.895 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:39.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:02:39.938 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:39.935+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:40.028 INFO:teuthology.orchestra.run.smithi005.stdout: marking collection for removal 2024-09-17T23:02:40.029 INFO:teuthology.orchestra.run.smithi005.stdout:setting '_remove' omap key 2024-09-17T23:02:40.029 INFO:teuthology.orchestra.run.smithi005.stdout:finish_remove_pgs 2.0_head removing 2.0 2024-09-17T23:02:40.031 INFO:teuthology.orchestra.run.smithi005.stdout:Remove successful 2024-09-17T23:02:40.039 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:40.036+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:40.047 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:40.047 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:40.056 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:02:40.141 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:40.139+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:40.161 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:40.161 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:40.170 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:02:40.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:02:40.254 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:40.252+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:40.313 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:40.313 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:40.323 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:02:40.343 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:40.340+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:40.444 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:40.442+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:40.466 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:40.466 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:40.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:40.545 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:40.543+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:40.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.0.1 2024-09-17T23:02:40.584 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:40.585 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:40.594 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:40.646 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:40.644+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:40.741 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:40.742 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:40.747 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:40.743+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:40.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:40.848 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:40.844+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:40.898 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:40.898 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:40.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:40.948 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:40.946+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:41.049 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:41.047+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:41.058 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:41.058 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:41.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:41.150 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:41.148+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:41.185 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:41.185 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:41.194 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:41.215 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:02:41.271 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:41.268+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:41.303 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:41.304 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:41.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:41.353 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:41.350+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:41.452 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:41.450+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:41.470 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:41.470 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:41.482 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:41.553 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:41.551+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:41.588 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:41.588 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:41.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:41.654 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:41.651+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:41.703 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:41.703 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:41.712 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:41.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:02:41.756 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:41.754+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:41.827 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:41.827 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:41.836 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:41.855 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:41.852+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:41.874 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:41.874 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:41.891 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:41.891 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:41.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:41.907 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:41.924 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:41.924 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:41.941 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:41.941 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:41.956 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:41.954+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:41.957 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:41.958 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:41.974 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:41.974 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:41.978 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:41.978 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:41.982 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:41.982 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:41.982 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:41.982 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:41.983 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:41.991 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:02:42.075 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:42.073+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:42.135 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:42.135 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:42.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:42.135 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:02:42.135 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:42.146 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:02:42.158 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:42.156+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:42.259 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:42.256+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:42.299 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:02:42.360 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:42.358+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:42.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:02:42.475 INFO:teuthology.orchestra.run.smithi005.stdout:get_pg_num_history pg_num_history pg_num_history(e21 pg_nums {1={15=1},2={18=8}} deleted_pools ) 2024-09-17T23:02:42.475 INFO:teuthology.orchestra.run.smithi005.stdout:Importing pgid 2.0 2024-09-17T23:02:42.475 INFO:teuthology.orchestra.run.smithi005.stdout:write_pg epoch 21 info 2.0( empty local-lis/les=18/19 n=0 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-17T23:02:42.476 INFO:teuthology.orchestra.run.smithi005.stdout:Import successful 2024-09-17T23:02:42.494 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:42.492+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 16.315954607999998, 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 16.312213324999998, 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 16.307350709000001, 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 16.306918719999999, 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.314452644999999, 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:42.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.31130686, 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:42.581 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:02:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.308577720000001, 2024-09-17T23:02:42.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:42.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:02:42.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.305154893999999, 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:02:42.592 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:42.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:02:42.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:42.596 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:42.598 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:02:42.598 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:42.595+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:42.698 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:42.695+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:42.740 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:42.741 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:42.741 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:42.741 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:42.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:02:42.799 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:42.797+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:42.853 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:42.853 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:42.853 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:42.853 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:42.853 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:42.861 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:02:42.902 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:42.900+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:42.993 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /var/log/ceph/exp.2.0.1 2024-09-17T23:02:43.000 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:42.998+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:43.003 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:43.003 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:43.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:43.003 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:02:43.003 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:43.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:02:43.101 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:43.099+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:43.157 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:43.157 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:43.157 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:43.157 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:43.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:02:43.207 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:43.205+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:43.231 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:02:43.303 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:43.301+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:43.309 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:43.309 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:43.309 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:43.309 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:43.309 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:43.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:02:43.404 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:43.402+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:43.465 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:43.465 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:43.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:43.465 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:43.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.249128295999999, 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.188649542, 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212078+0000", 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.669e-06 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212092+0000", 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4959e-05 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212105+0000", 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2283000000000001e-05 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212114+0000", 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8990000000000007e-06 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212177+0000", 2024-09-17T23:02:43.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3533000000000003e-05 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212187+0000", 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4790000000000002e-06 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399184+0000", 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.18699711599999999 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399382+0000", 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019809299999999999 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399604+0000", 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00022205 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400259+0000", 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065476499999999997 2024-09-17T23:02:43.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400634+0000", 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00037537600000000002 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400675+0000", 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1291999999999997e-05 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400725+0000", 2024-09-17T23:02:43.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0028000000000003e-05 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:21 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 65536~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.040908004999999, 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076785070000000002, 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.473 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 21 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:43.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420297+0000", 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.54e-07 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420377+0000", 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9809999999999997e-05 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420387+0000", 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0026e-05 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420391+0000", 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5510000000000001e-06 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420833+0000", 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044210300000000001 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420887+0000", 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3324e-05 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420973+0000", 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6428999999999995e-05 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422150+0000", 2024-09-17T23:02:43.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011773039999999999 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427781+0000", 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056303120000000002 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427900+0000", 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000118769 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427975+0000", 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5124999999999996e-05 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:22 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.040799162999999, 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0077273339999999998, 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.479 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 22 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420406+0000", 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4000000000000001e-07 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420410+0000", 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5789999999999997e-06 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420417+0000", 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8900000000000001e-06 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420423+0000", 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7679999999999997e-06 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421317+0000", 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00089395000000000002 2024-09-17T23:02:43.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421370+0000", 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3492999999999998e-05 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421455+0000", 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4351000000000006e-05 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422372+0000", 2024-09-17T23:02:43.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091742899999999999 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427997+0000", 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056245289999999996 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428104+0000", 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106944 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428132+0000", 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8761000000000001e-05 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.843180128, 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063598999999999999, 2024-09-17T23:02:43.485 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 110 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618025+0000", 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8400000000000004e-07 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618029+0000", 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1489999999999996e-06 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618037+0000", 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0979999999999994e-06 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618047+0000", 2024-09-17T23:02:43.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0247e-05 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622380+0000", 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043329900000000001 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622456+0000", 2024-09-17T23:02:43.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6040999999999999e-05 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622592+0000", 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013632600000000001 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624289+0000", 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696737 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624301+0000", 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2099000000000001e-05 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624346+0000", 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4634e-05 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624384+0000", 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7994999999999998e-05 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.843130357, 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0064380779999999999, 2024-09-17T23:02:43.492 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 111 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:43.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9699999999999996e-07 2024-09-17T23:02:43.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618078+0000", 2024-09-17T23:02:43.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.811e-06 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618092+0000", 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.413e-05 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618103+0000", 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0232e-05 2024-09-17T23:02:43.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623161+0000", 2024-09-17T23:02:43.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050586880000000004 2024-09-17T23:02:43.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623220+0000", 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8449000000000002e-05 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623293+0000", 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3139000000000006e-05 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624390+0000", 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00109734 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624455+0000", 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4478000000000002e-05 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624489+0000", 2024-09-17T23:02:43.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3853000000000003e-05 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624512+0000", 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3360999999999999e-05 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:43.500 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.843084280999999, 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0074594789999999998, 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 112 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618121+0000", 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7000000000000004e-07 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618204+0000", 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3512999999999998e-05 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618213+0000", 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2359999999999993e-06 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618219+0000", 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1770000000000003e-06 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623528+0000", 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053089269999999997 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623604+0000", 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5462000000000004e-05 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623734+0000", 2024-09-17T23:02:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013053399999999999 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625477+0000", 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001742653 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625492+0000", 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4825e-05 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625539+0000", 2024-09-17T23:02:43.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7033999999999997e-05 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625579+0000", 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0448000000000003e-05 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:43.506 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.842972239000002, 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0082098180000000007, 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 113 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:43.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618233+0000", 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1200000000000003e-07 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618240+0000", 2024-09-17T23:02:43.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2989999999999999e-06 2024-09-17T23:02:43.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618247+0000", 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.542e-06 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618252+0000", 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8010000000000003e-06 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624556+0000", 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063039050000000003 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624641+0000", 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4456999999999995e-05 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624763+0000", 2024-09-17T23:02:43.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000122917 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625627+0000", 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086396699999999999 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626341+0000", 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00071333799999999999 2024-09-17T23:02:43.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626391+0000", 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0192999999999999e-05 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626442+0000", 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0787e-05 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.842944205999999, 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0087386709999999999, 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.514 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 114 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3799999999999998e-07 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618263+0000", 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8820000000000001e-06 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618267+0000", 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0840000000000002e-06 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618271+0000", 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8449999999999996e-06 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625074+0000", 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068027599999999997 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625121+0000", 2024-09-17T23:02:43.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6805999999999999e-05 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625206+0000", 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5538999999999995e-05 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626903+0000", 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696454 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626916+0000", 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3634e-05 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626962+0000", 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5357e-05 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626999+0000", 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6971999999999998e-05 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.842925209000001, 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093097030000000008, 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.520 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 115 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.27e-07 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618326+0000", 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6261999999999999e-05 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618331+0000", 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0889999999999999e-06 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618334+0000", 2024-09-17T23:02:43.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.23e-06 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625664+0000", 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0073300989999999996 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625739+0000", 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5535000000000001e-05 2024-09-17T23:02:43.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625882+0000", 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014275299999999999 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627033+0000", 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001151116 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627506+0000", 2024-09-17T23:02:43.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047273299999999997 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627550+0000", 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4189e-05 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627589+0000", 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.837e-05 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.526 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.842861629000001, 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093607020000000003, 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.527 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 116 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9299999999999998e-07 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618347+0000", 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.664e-06 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618351+0000", 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3359999999999997e-06 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618354+0000", 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8540000000000001e-06 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626489+0000", 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0081350580000000006 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626538+0000", 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9490999999999998e-05 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626617+0000", 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8404000000000004e-05 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627611+0000", 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00099458599999999999 2024-09-17T23:02:43.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627624+0000", 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2598e-05 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627668+0000", 2024-09-17T23:02:43.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3501000000000002e-05 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627703+0000", 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5716999999999997e-05 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.842845360999998, 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.009520489, 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.534 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 117 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2399999999999999e-07 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618361+0000", 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1059999999999998e-06 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618365+0000", 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6150000000000001e-06 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618367+0000", 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6790000000000001e-06 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627063+0000", 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0086957619999999992 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627146+0000", 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2879000000000004e-05 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627287+0000", 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014122700000000001 2024-09-17T23:02:43.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627757+0000", 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000470066 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627820+0000", 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.279e-05 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627856+0000", 2024-09-17T23:02:43.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5463999999999998e-05 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627879+0000", 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3677e-05 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.437787905, 2024-09-17T23:02:43.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0075600570000000002, 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 137 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:43.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023417+0000", 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8599999999999998e-07 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023466+0000", 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8794000000000001e-05 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023474+0000", 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7139999999999999e-06 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023480+0000", 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8019999999999997e-06 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027360+0000", 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038796270000000001 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027440+0000", 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0753000000000004e-05 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027519+0000", 2024-09-17T23:02:43.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8203999999999999e-05 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028755+0000", 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012362790000000001 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030928+0000", 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021728120000000001 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030954+0000", 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5910000000000001e-05 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030976+0000", 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2676000000000001e-05 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.437706817999999, 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076214569999999999, 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 138 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.547 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023498+0000", 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8800000000000002e-07 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023503+0000", 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3669999999999996e-06 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023510+0000", 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7889999999999997e-06 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023519+0000", 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.098e-06 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028869+0000", 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053500609999999997 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028946+0000", 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6508999999999995e-05 2024-09-17T23:02:43.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029084+0000", 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013776700000000001 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030981+0000", 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001897971 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031025+0000", 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3883e-05 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031079+0000", 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3325999999999997e-05 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031119+0000", 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0098000000000001e-05 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.552 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.437675806000001, 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076808450000000004, 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 139 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023529+0000", 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023532+0000", 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.456e-06 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023539+0000", 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6540000000000002e-06 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023544+0000", 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1529999999999996e-06 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029398+0000", 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0058541829999999998 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029444+0000", 2024-09-17T23:02:43.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5605999999999997e-05 2024-09-17T23:02:43.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029521+0000", 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6689999999999999e-05 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031156+0000", 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0016352700000000001 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031163+0000", 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9269999999999999e-06 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031187+0000", 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4235000000000001e-05 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031209+0000", 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.213e-05 2024-09-17T23:02:43.559 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.437648644999999, 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0078442649999999996, 2024-09-17T23:02:43.560 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 140 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:43.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0200000000000002e-07 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023622+0000", 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6181999999999998e-05 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023631+0000", 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5750000000000001e-06 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023638+0000", 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4630000000000004e-06 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029770+0000", 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0061317089999999999 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029845+0000", 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5439999999999996e-05 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029968+0000", 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012251800000000001 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031244+0000", 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012764359999999999 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031339+0000", 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4217999999999998e-05 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031380+0000", 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1258999999999999e-05 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031400+0000", 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9962999999999998e-05 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.437552061000002, 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0085476930000000003, 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.568 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 141 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023653+0000", 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6499999999999999e-07 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023657+0000", 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0400000000000003e-06 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023664+0000", 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1790000000000002e-06 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023669+0000", 2024-09-17T23:02:43.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3029999999999999e-06 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030600+0000", 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069304589999999999 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030647+0000", 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7354000000000001e-05 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030718+0000", 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1116000000000001e-05 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031458+0000", 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00074007599999999999 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032158+0000", 2024-09-17T23:02:43.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069986799999999997 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032181+0000", 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2832000000000001e-05 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032200+0000", 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8800999999999998e-05 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.574 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.928842492000001, 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068810570000000003, 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.575 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 156 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8999999999999997e-07 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532365+0000", 2024-09-17T23:02:43.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0079999999999998e-06 2024-09-17T23:02:43.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532371+0000", 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1369999999999999e-06 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532378+0000", 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.443e-06 2024-09-17T23:02:43.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533797+0000", 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0014196530000000001 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533838+0000", 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0629e-05 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533916+0000", 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8107000000000003e-05 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535288+0000", 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001372123 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539185+0000", 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038971600000000002 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539219+0000", 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3905000000000001e-05 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539243+0000", 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3402000000000001e-05 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.928818756999998, 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069027610000000003, 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 157 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532386+0000", 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5999999999999999e-07 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532393+0000", 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8929999999999999e-06 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532398+0000", 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6869999999999999e-06 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532407+0000", 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8270000000000004e-06 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534365+0000", 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0019577510000000002 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534418+0000", 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2936000000000003e-05 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534482+0000", 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4212000000000001e-05 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535659+0000", 2024-09-17T23:02:43.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011769230000000001 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539247+0000", 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0035881020000000001 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539269+0000", 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1807e-05 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539288+0000", 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9162999999999999e-05 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.928785517000001, 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.006929943, 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.590 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 158 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:43.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5300000000000004e-07 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532590+0000", 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017035600000000001 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532598+0000", 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4009999999999997e-06 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532604+0000", 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9209999999999997e-06 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534755+0000", 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021515750000000002 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534795+0000", 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9229e-05 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534866+0000", 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1607999999999996e-05 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535934+0000", 2024-09-17T23:02:43.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001068049 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539293+0000", 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033591300000000001 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539328+0000", 2024-09-17T23:02:43.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4715999999999998e-05 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539349+0000", 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0404999999999999e-05 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.597 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.928589596999998, 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0067798900000000002, 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:43.598 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 159 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:43.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1999999999999999e-07 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532619+0000", 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6859999999999999e-06 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532626+0000", 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3810000000000001e-06 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532632+0000", 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7049999999999996e-06 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535305+0000", 2024-09-17T23:02:43.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0026735190000000001 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535345+0000", 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9313000000000001e-05 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535408+0000", 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3072999999999997e-05 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.536170+0000", 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076224300000000001 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539352+0000", 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0031817310000000001 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:43.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539376+0000", 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3743e-05 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539394+0000", 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8876e-05 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:43.604 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:43.605 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:43.606 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:43.604+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:43.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:43.707 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:43.703+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:43.716 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:43.716 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:43.716 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:43.716 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:43.725 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:43.809 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:43.806+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:43.872 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:43.872 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:43.872 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:43.872 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:43.872 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:43.881 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:43.921 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:43.918+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:43.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:02:44.009 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:44.008+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:44.031 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:02:44.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.606526493, 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:44.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:02:44.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.606079580999999, 2024-09-17T23:02:44.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:44.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:02:44.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.589400940000001, 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:02:44.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:02:44.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.588847269999999, 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:02:44.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:02:44.050 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.588235646000001, 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.053 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.054 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.587582947000001, 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.058 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:02:44.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.587046807, 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.060 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.063 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.064 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.572243610000001, 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.065 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.066 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:02:44.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.068 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.069 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.571900927000002, 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.070 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.071 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:02:44.073 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.571331541999999, 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:02:44.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.078 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.568851359, 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:02:44.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.561347893000001, 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.083 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:02:44.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.560846447999999, 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:02:44.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:44.092 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.558210726999999, 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:02:44.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.550353055999999, 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:02:44.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.101 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.412247231999999, 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:44.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:02:44.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.002944832000001, 2024-09-17T23:02:44.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:44.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:02:44.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.001430446000001, 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:02:44.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 21.497596952999999, 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:44.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 21.492195833, 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:02:44.120 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:44.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:44.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:02:44.124 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.125 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:44.125 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:44.125 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:44.126 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:44.127 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:44.127 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:44.128 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:44.128 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:44.128 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:44.123+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:44.139 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:44.139 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:44.157 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:44.157 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:44.176 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:44.176 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:44.193 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:44.193 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:44.211 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:44.211 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:44.215 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:44.216 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:44.227 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:44.225+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:44.231 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:02:44.251 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:44.251 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:44.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:44.328 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:44.326+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:44.407 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:44.407 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:44.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:44.428 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:44.426+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:44.523 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:44.524 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:44.529 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:44.526+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:44.532 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:44.630 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:44.628+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:44.639 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:44.639 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:44.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:44.731 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:44.729+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:44.754 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:44.754 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:44.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:44.832 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:44.829+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:44.870 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:44.870 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:44.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:44.933 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:44.931+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:44.995 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:45.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:45.035 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:45.032+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:45.109 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:45.109 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:45.118 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:02:45.161 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:45.159+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:45.220 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:45.221 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:45.229 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:02:45.235 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:45.232+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:45.336 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:45.334+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:45.372 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:45.372 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:45.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:02:45.437 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:45.434+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:45.524 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:45.524 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:45.533 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:02:45.538 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:45.535+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:45.636 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:45.638 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:45.635+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:45.644 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:02:45.739 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:45.736+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:45.748 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:45.748 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:45.756 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:02:45.840 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:45.838+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:45.901 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:45.901 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:45.909 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:02:45.941 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:45.939+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:46.042 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:46.039+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:46.052 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:46.052 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:46.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:02:46.142 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:46.140+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:46.165 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:46.165 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:46.174 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:02:46.217 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:02:46.243 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:46.241+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:46.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:02:46.279 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:46.279 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:46.290 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:02:46.343 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:46.340+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:46.372 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:46.372 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:46.393 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:46.393 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:46.409 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:46.409 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:46.427 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:46.427 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:46.436 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:46.436 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:46.444 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:46.444 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:46.444 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:46.441+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:46.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:46.476 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:46.476 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:46.493 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:46.494 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:46.499 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:46.499 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:46.546 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:46.542+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:46.554 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:46.554 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:46.554 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:46.555 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:46.563 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:46.648 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:46.645+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:46.711 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:46.711 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:46.711 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:46.711 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:46.711 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:46.720 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:46.747 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:46.745+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:46.848 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:46.845+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:46.868 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.445245522, 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.869 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:02:46.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.873 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.444798609999999, 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:46.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.428119969000001, 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.878 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:02:46.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.882 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.427566298999999, 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:02:46.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:02:46.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.426954675000001, 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:46.891 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.426301976000001, 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:02:46.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:02:46.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.425765836, 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:02:46.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.899 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.410962639000001, 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.410619956000001, 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:46.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:02:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.410050570999999, 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:46.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.407570388, 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:46.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.400066922000001, 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:02:46.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.921 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.399565476999999, 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:02:46.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.396929755999999, 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.926 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.928 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.389072084999999, 2024-09-17T23:02:46.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:02:46.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.933 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.934 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 25.250966260999999, 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:02:46.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:02:46.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:02:46.938 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 24.841663861000001, 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:02:46.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:02:46.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 24.840149475, 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:02:46.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:02:46.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:02:46.947 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 24.336315981999999, 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.951 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 24.330914862, 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:46.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:46.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:02:46.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:46.955 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:46.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:02:46.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:02:46.956 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.956 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.956 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.956 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:46.956 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:46.956 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:46.957 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:46.958 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:46.955+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:47.058 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:47.056+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:47.104 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:47.104 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:47.104 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:47.104 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:47.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:47.158 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:47.156+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:47.220 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:47.220 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:47.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:47.238 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:02:47.259 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:47.257+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:47.337 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 21.097090481999999, 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.338 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:47.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:02:47.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:47.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:47.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:47.343 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:47.343 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:47.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:47.360 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:47.358+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:47.454 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:47.454 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:47.454 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:47.454 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:47.460 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:47.458+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:47.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:47.561 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:47.559+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:47.569 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:47.569 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:47.569 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:47.569 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:47.569 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:47.578 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:47.662 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:47.660+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:47.684 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:47.684 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:47.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:47.684 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:02:47.684 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:47.693 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:47.763 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:47.761+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:47.808 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:47.808 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:47.808 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:47.808 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:47.817 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:47.864 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:47.862+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:47.920 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:47.921 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:47.921 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:47.921 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:47.921 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:47.929 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:02:47.970 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:47.968+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:48.064 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-17T23:02:48.064 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:02:48.065 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-17T23:02:48.065 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-17T23:02:48.066 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:48.064+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:48.074 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:48.074 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:48.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:48.074 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:02:48.074 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:48.083 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:02:48.167 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:48.164+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:48.227 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:48.228 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:48.228 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:48.236 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:02:48.268 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:48.264+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:48.338 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:48.338 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:48.338 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:48.338 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:48.338 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:48.346 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:02:48.368 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-17T23:02:48.365+0000 7fcae0ef7640 -1 mon.a@0(leader).osd e27 definitely_dead 0 2024-09-17T23:02:48.368 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:48.365+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:48.450 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.211751753000001, 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:02:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:02:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.208010470000001, 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:02:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:02:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.203147854000001, 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:02:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.202715864999998, 2024-09-17T23:02:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:02:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.210249789999999, 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:02:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.207104005000001, 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:02:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.204374864999998, 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:02:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:02:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.200952039000001, 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:02:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:48.493 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:48.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:02:48.495 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:48.491+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:48.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:02:48.595 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:48.591+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:48.598 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:48.598 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:48.598 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:48.598 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:48.607 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:02:48.624 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:48.625 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:48.642 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:48.642 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:48.658 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:48.658 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:48.675 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:48.675 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:48.691 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:48.692 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:48.696 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:48.693+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:48.709 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:48.710 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:48.712 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:48.712 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:48.721 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:02:48.726 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:48.726 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:48.729 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:48.730 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:48.797 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:48.795+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:48.864 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:48.864 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:48.872 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:02:48.916 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:48.914+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:48.976 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:48.976 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:48.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:02:49.025 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:49.023+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:49.100 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:49.097+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:49.127 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:49.127 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:49.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:02:49.200 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:49.198+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:49.239 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:49.243 INFO:teuthology.orchestra.run.smithi005.stderr:marked out osd.4. 2024-09-17T23:02:49.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:49.254 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:02:49.301 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:49.299+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:49.363 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:49.363 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:49.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:49.402 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:49.400+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:49.482 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:49.482 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:49.491 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:49.534 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:49.532+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:49.599 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:49.599 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:49.604 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:49.602+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:49.607 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:49.705 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:49.702+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:49.754 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:49.754 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:49.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:49.806 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:49.804+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:49.906 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:49.904+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:49.910 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:49.910 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:49.919 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:50.007 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:50.005+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:50.026 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:50.026 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:50.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:50.108 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:50.106+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:50.141 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:50.141 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:50.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:50.209 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:50.207+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:50.249 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:02:50.299 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:50.299 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:50.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:50.349 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:50.347+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:50.411 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:50.409+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:50.461 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:50.462 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:50.471 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:50.515 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:50.513+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:50.587 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:50.587 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:50.597 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:50.638 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:50.636+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:50.714 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:50.712+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:50.731 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:02:50.741 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:50.741 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:50.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:02:50.815 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:50.812+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:50.856 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:50.857 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:50.876 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:50.877 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:50.894 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:50.895 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:50.895 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:50.895 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:50.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:02:50.914 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:50.914 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:50.915 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:50.913+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:50.933 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:50.933 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:50.949 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:50.950 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:50.968 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:50.968 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:50.972 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:50.972 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:51.008 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:51.008 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:51.009 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:51.009 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:51.016 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:51.014+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:51.017 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:02:51.116 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:51.114+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:51.161 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:51.161 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:51.161 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:51.162 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:51.162 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:51.170 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:02:51.217 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:51.215+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.035822285999998, 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:02:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:02:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:02:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:02:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:02:51.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:02:51.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.032081002999998, 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:51.283 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:51.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:02:51.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:51.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.027218387000001, 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:02:51.288 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:51.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:02:51.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:02:51.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:02:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.293 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.026786397999999, 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.294 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:02:51.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.034320322999999, 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:51.299 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:51.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:02:51.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:02:51.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:51.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:02:51.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:02:51.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:51.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:02:51.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:02:51.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:51.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:02:51.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:02:51.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:51.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:02:51.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:02:51.308 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.308 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.308 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.308 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:02:51.308 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:51.308 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.031174537999998, 2024-09-17T23:02:51.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:02:51.309 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:51.309 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:51.309 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:51.309 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:51.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:51.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:51.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:51.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:51.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:51.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:02:51.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:02:51.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:51.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:02:51.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:02:51.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:51.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:02:51.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:02:51.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:51.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:02:51.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:02:51.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:02:51.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:02:51.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:51.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:02:51.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:02:51.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:51.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:02:51.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:02:51.315 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.315 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.316 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.316 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:02:51.316 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:51.316 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.028445397999999, 2024-09-17T23:02:51.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:02:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:02:51.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.318 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:51.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:51.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:51.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:51.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:51.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:51.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:02:51.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:02:51.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:51.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:02:51.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:02:51.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:51.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:02:51.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:02:51.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:51.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:02:51.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:02:51.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:02:51.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:02:51.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:51.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:02:51.326 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:51.327 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.025022572000001, 2024-09-17T23:02:51.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:02:51.327 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:51.327 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:51.327 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:51.327 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:51.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:51.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:51.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:51.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:51.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:51.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:51.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:02:51.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:02:51.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:51.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:02:51.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:02:51.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.330 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:51.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:02:51.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:51.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:51.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:02:51.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:02:51.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:51.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:02:51.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:02:51.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.332 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:51.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:02:51.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:02:51.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:51.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:51.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:51.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:02:51.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:02:51.333 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.333 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.334 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.334 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:51.334 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:51.334 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:51.336 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:02:51.337 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:51.333+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:51.437 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:51.434+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:51.480 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:51.481 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:51.481 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:51.481 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:51.489 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:02:51.537 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:51.535+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:51.633 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:51.634 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:51.634 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:51.634 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:51.634 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:51.638 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:51.636+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:51.642 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:02:51.739 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:51.737+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:51.785 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:51.785 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:51.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:51.785 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:02:51.785 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:51.794 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:02:51.840 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:51.838+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:51.897 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:51.897 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:51.897 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:51.897 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:51.905 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:02:51.946 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:51.944+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:52.042 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:52.040+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:52.048 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:52.048 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:52.048 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:52.049 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:52.057 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:02:52.143 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:52.140+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:52.162 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:52.162 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.947126580999999, 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.188649542, 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.163 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212078+0000", 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.669e-06 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212092+0000", 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4959e-05 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212105+0000", 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2283000000000001e-05 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212114+0000", 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8990000000000007e-06 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212177+0000", 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3533000000000003e-05 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212187+0000", 2024-09-17T23:02:52.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4790000000000002e-06 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399184+0000", 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.18699711599999999 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399382+0000", 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019809299999999999 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399604+0000", 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00022205 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400259+0000", 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065476499999999997 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400634+0000", 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00037537600000000002 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400675+0000", 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1291999999999997e-05 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400725+0000", 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0028000000000003e-05 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:21 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 65536~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:52.169 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.738906289999999, 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076785070000000002, 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 21 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420297+0000", 2024-09-17T23:02:52.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.54e-07 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420377+0000", 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9809999999999997e-05 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420387+0000", 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0026e-05 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420391+0000", 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5510000000000001e-06 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420833+0000", 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044210300000000001 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420887+0000", 2024-09-17T23:02:52.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3324e-05 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420973+0000", 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6428999999999995e-05 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422150+0000", 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011773039999999999 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427781+0000", 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056303120000000002 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427900+0000", 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000118769 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427975+0000", 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5124999999999996e-05 2024-09-17T23:02:52.175 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:22 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.738797448, 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0077273339999999998, 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.176 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 22 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:02:52.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420406+0000", 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4000000000000001e-07 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420410+0000", 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5789999999999997e-06 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420417+0000", 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8900000000000001e-06 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420423+0000", 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7679999999999997e-06 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421317+0000", 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00089395000000000002 2024-09-17T23:02:52.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421370+0000", 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3492999999999998e-05 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421455+0000", 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4351000000000006e-05 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422372+0000", 2024-09-17T23:02:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091742899999999999 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427997+0000", 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056245289999999996 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428104+0000", 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106944 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428132+0000", 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8761000000000001e-05 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.541178413000001, 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063598999999999999, 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.182 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 110 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.183 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618025+0000", 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8400000000000004e-07 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618029+0000", 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1489999999999996e-06 2024-09-17T23:02:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618037+0000", 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0979999999999994e-06 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618047+0000", 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0247e-05 2024-09-17T23:02:52.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622380+0000", 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043329900000000001 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622456+0000", 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6040999999999999e-05 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.188 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622592+0000", 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013632600000000001 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624289+0000", 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696737 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624301+0000", 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2099000000000001e-05 2024-09-17T23:02:52.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624346+0000", 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4634e-05 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624384+0000", 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7994999999999998e-05 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.541128642, 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0064380779999999999, 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 111 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.191 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9699999999999996e-07 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618078+0000", 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.811e-06 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618092+0000", 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.413e-05 2024-09-17T23:02:52.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618103+0000", 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0232e-05 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623161+0000", 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050586880000000004 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623220+0000", 2024-09-17T23:02:52.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8449000000000002e-05 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623293+0000", 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3139000000000006e-05 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624390+0000", 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00109734 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624455+0000", 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4478000000000002e-05 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624489+0000", 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3853000000000003e-05 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624512+0000", 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3360999999999999e-05 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.196 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.541082566, 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0074594789999999998, 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.197 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 112 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:02:52.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618121+0000", 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7000000000000004e-07 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618204+0000", 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3512999999999998e-05 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618213+0000", 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2359999999999993e-06 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618219+0000", 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1770000000000003e-06 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623528+0000", 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053089269999999997 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623604+0000", 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5462000000000004e-05 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623734+0000", 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013053399999999999 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625477+0000", 2024-09-17T23:02:52.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001742653 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625492+0000", 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4825e-05 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625539+0000", 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7033999999999997e-05 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.202 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625579+0000", 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0448000000000003e-05 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.540970523999999, 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0082098180000000007, 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.203 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 113 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:02:52.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618233+0000", 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1200000000000003e-07 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618240+0000", 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2989999999999999e-06 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618247+0000", 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.542e-06 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618252+0000", 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8010000000000003e-06 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624556+0000", 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063039050000000003 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624641+0000", 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4456999999999995e-05 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624763+0000", 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000122917 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625627+0000", 2024-09-17T23:02:52.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086396699999999999 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626341+0000", 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00071333799999999999 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626391+0000", 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0192999999999999e-05 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626442+0000", 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0787e-05 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.540942490999999, 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0087386709999999999, 2024-09-17T23:02:52.209 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 114 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3799999999999998e-07 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618263+0000", 2024-09-17T23:02:52.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8820000000000001e-06 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618267+0000", 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0840000000000002e-06 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618271+0000", 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8449999999999996e-06 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625074+0000", 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068027599999999997 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625121+0000", 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6805999999999999e-05 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625206+0000", 2024-09-17T23:02:52.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5538999999999995e-05 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626903+0000", 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696454 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626916+0000", 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3634e-05 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626962+0000", 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5357e-05 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626999+0000", 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6971999999999998e-05 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.215 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.540923494000001, 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093097030000000008, 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 115 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:02:52.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.27e-07 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618326+0000", 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6261999999999999e-05 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618331+0000", 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0889999999999999e-06 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618334+0000", 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.23e-06 2024-09-17T23:02:52.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625664+0000", 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0073300989999999996 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625739+0000", 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5535000000000001e-05 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625882+0000", 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014275299999999999 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627033+0000", 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001151116 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627506+0000", 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047273299999999997 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627550+0000", 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4189e-05 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627589+0000", 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.837e-05 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.221 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.540859913999999, 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093607020000000003, 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 116 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9299999999999998e-07 2024-09-17T23:02:52.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618347+0000", 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.664e-06 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618351+0000", 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3359999999999997e-06 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618354+0000", 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8540000000000001e-06 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626489+0000", 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0081350580000000006 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626538+0000", 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9490999999999998e-05 2024-09-17T23:02:52.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626617+0000", 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8404000000000004e-05 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627611+0000", 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00099458599999999999 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627624+0000", 2024-09-17T23:02:52.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2598e-05 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627668+0000", 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3501000000000002e-05 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627703+0000", 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5716999999999997e-05 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.227 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.540843645999999, 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.009520489, 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 117 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2399999999999999e-07 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618361+0000", 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1059999999999998e-06 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618365+0000", 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6150000000000001e-06 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618367+0000", 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6790000000000001e-06 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627063+0000", 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0086957619999999992 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627146+0000", 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2879000000000004e-05 2024-09-17T23:02:52.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627287+0000", 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014122700000000001 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627757+0000", 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000470066 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627820+0000", 2024-09-17T23:02:52.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.279e-05 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627856+0000", 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5463999999999998e-05 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627879+0000", 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3677e-05 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.233 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.135786190000001, 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0075600570000000002, 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.234 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 137 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023417+0000", 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8599999999999998e-07 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023466+0000", 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8794000000000001e-05 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023474+0000", 2024-09-17T23:02:52.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7139999999999999e-06 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023480+0000", 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8019999999999997e-06 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027360+0000", 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038796270000000001 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027440+0000", 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0753000000000004e-05 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027519+0000", 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8203999999999999e-05 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028755+0000", 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012362790000000001 2024-09-17T23:02:52.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030928+0000", 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021728120000000001 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030954+0000", 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5910000000000001e-05 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030976+0000", 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2676000000000001e-05 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.135705102999999, 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076214569999999999, 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.240 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 138 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023498+0000", 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8800000000000002e-07 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023503+0000", 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3669999999999996e-06 2024-09-17T23:02:52.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023510+0000", 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7889999999999997e-06 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023519+0000", 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.098e-06 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028869+0000", 2024-09-17T23:02:52.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053500609999999997 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028946+0000", 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6508999999999995e-05 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029084+0000", 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013776700000000001 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030981+0000", 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001897971 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031025+0000", 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3883e-05 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031079+0000", 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3325999999999997e-05 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031119+0000", 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0098000000000001e-05 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.135674090999998, 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076808450000000004, 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.246 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 139 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023529+0000", 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023532+0000", 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.456e-06 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023539+0000", 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6540000000000002e-06 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023544+0000", 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1529999999999996e-06 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029398+0000", 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0058541829999999998 2024-09-17T23:02:52.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029444+0000", 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5605999999999997e-05 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029521+0000", 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6689999999999999e-05 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031156+0000", 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0016352700000000001 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031163+0000", 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9269999999999999e-06 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031187+0000", 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4235000000000001e-05 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031209+0000", 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.213e-05 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.13564693, 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0078442649999999996, 2024-09-17T23:02:52.252 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 140 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0200000000000002e-07 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023622+0000", 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6181999999999998e-05 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023631+0000", 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5750000000000001e-06 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023638+0000", 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4630000000000004e-06 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029770+0000", 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0061317089999999999 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029845+0000", 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5439999999999996e-05 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029968+0000", 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012251800000000001 2024-09-17T23:02:52.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031244+0000", 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012764359999999999 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031339+0000", 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4217999999999998e-05 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031380+0000", 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1258999999999999e-05 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031400+0000", 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9962999999999998e-05 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.258 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.135550345999999, 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0085476930000000003, 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 141 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023653+0000", 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6499999999999999e-07 2024-09-17T23:02:52.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023657+0000", 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0400000000000003e-06 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023664+0000", 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1790000000000002e-06 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.261 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023669+0000", 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3029999999999999e-06 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030600+0000", 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069304589999999999 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030647+0000", 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7354000000000001e-05 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.262 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030718+0000", 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1116000000000001e-05 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031458+0000", 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00074007599999999999 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032158+0000", 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069986799999999997 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032181+0000", 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2832000000000001e-05 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032200+0000", 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8800999999999998e-05 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.626840776999998, 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068810570000000003, 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 156 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:02:52.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8999999999999997e-07 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532365+0000", 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0079999999999998e-06 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532371+0000", 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1369999999999999e-06 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532378+0000", 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.443e-06 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533797+0000", 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0014196530000000001 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533838+0000", 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0629e-05 2024-09-17T23:02:52.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533916+0000", 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8107000000000003e-05 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535288+0000", 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001372123 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539185+0000", 2024-09-17T23:02:52.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038971600000000002 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539219+0000", 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3905000000000001e-05 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539243+0000", 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3402000000000001e-05 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.626817041999999, 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069027610000000003, 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 157 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.271 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532386+0000", 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5999999999999999e-07 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532393+0000", 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8929999999999999e-06 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532398+0000", 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6869999999999999e-06 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532407+0000", 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8270000000000004e-06 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534365+0000", 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0019577510000000002 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534418+0000", 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2936000000000003e-05 2024-09-17T23:02:52.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534482+0000", 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4212000000000001e-05 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535659+0000", 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011769230000000001 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539247+0000", 2024-09-17T23:02:52.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0035881020000000001 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539269+0000", 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1807e-05 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539288+0000", 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9162999999999999e-05 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.626783801999999, 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.006929943, 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 158 2024-09-17T23:02:52.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5300000000000004e-07 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532590+0000", 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017035600000000001 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532598+0000", 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4009999999999997e-06 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532604+0000", 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9209999999999997e-06 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534755+0000", 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021515750000000002 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534795+0000", 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9229e-05 2024-09-17T23:02:52.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534866+0000", 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1607999999999996e-05 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535934+0000", 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001068049 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539293+0000", 2024-09-17T23:02:52.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033591300000000001 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539328+0000", 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4715999999999998e-05 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539349+0000", 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0404999999999999e-05 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.282 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.626587881999999, 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0067798900000000002, 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 159 2024-09-17T23:02:52.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1999999999999999e-07 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532619+0000", 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6859999999999999e-06 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532626+0000", 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3810000000000001e-06 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532632+0000", 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7049999999999996e-06 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535305+0000", 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0026735190000000001 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535345+0000", 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9313000000000001e-05 2024-09-17T23:02:52.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535408+0000", 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3072999999999997e-05 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.536170+0000", 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076224300000000001 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539352+0000", 2024-09-17T23:02:52.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0031817310000000001 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539376+0000", 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3743e-05 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539394+0000", 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8876e-05 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.288 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.289 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:52.289 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:52.289 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:52.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:02:52.291 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:52.288+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:52.291 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:52.391 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:52.388+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:52.401 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:52.401 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:52.402 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:52.402 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:52.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:52.492 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:52.490+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:52.524 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:52.524 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:52.524 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:52.524 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:52.524 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:52.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:52.592 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:52.590+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:52.647 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:52.647 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:52.647 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:52.647 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:02:52.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.647 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.222694018999999, 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.648 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:02:52.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:02:52.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.651 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.222247107000001, 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:02:52.652 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.655 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:02:52.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.205568465999999, 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.657 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:02:52.658 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.659 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:02:52.660 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.205014796, 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:02:52.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:02:52.665 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.666 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.204403171999999, 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:02:52.668 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.669 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.670 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.203750472999999, 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.671 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.672 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:02:52.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:02:52.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.675 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.203214332999998, 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.676 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:02:52.677 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.678 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.188411135999999, 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.681 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:02:52.683 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.188068453, 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.685 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:02:52.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.187499068000001, 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.690 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:02:52.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:02:52.692 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.185018885000002, 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.695 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:02:52.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.699 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.177515418999999, 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:02:52.700 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:52.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:02:52.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:02:52.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.705 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.177013974000001, 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:02:52.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:02:52.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.174378253, 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:02:52.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.166520582, 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.717 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:02:52.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:02:52.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:52.721 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 31.028414758, 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.722 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.723 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:02:52.724 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:02:52.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.726 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 30.619112357999999, 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.727 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.728 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.729 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:02:52.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.731 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 30.617597971999999, 2024-09-17T23:02:52.732 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.734 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:02:52.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:02:52.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 30.113764479, 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:02:52.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:02:52.743 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 30.108363358999998, 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:02:52.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:52.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:52.749 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:52.750 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:52.751 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:52.748+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:52.851 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:52.849+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:52.898 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:52.898 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:52.899 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:52.899 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:52.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:52.951 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:52.949+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:52.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:02:53.016 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:53.016 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:53.016 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:53.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:53.067 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:53.065+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:53.108 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:53.108 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:53.126 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:53.126 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:53.143 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:53.144 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:53.153 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:53.151+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:53.161 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:53.162 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:53.179 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:53.179 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:53.192 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:53.192 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:53.197 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:53.197 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:53.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:53.215 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:53.215 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:53.218 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:53.219 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:53.250 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:02:53.254 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:53.252+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:53.328 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:53.328 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:53.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:53.355 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:53.353+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:53.446 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:53.446 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:53.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:53.457 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:53.454+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:53.557 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:53.555+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:53.566 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:53.566 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:53.575 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:53.658 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:53.656+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:53.689 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:53.689 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:53.698 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:53.758 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:53.756+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:53.801 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:53.801 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:53.810 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:02:53.859 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:53.857+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:53.954 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:53.954 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:53.959 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:53.957+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:53.964 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:02:54.061 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:54.059+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:54.107 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:54.107 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:54.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:02:54.200 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:54.198+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:54.260 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:54.261 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:54.261 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-17T23:02:54.261 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:02:54.261 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-17T23:02:54.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 reset_purged_snaps_last 2024-09-17T23:02:54.262 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:54.260+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:54.269 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:02:54.364 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:54.362+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:54.404 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-17T23:02:54.414 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:54.415 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:54.423 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:02:54.465 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:54.463+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:54.515 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:54.518 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:54.518 INFO:tasks.thrashosds.thrasher:Failed to reset_purged_snaps_last, ignoring 2024-09-17T23:02:54.519 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-17T23:02:54.566 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:54.564+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:54.568 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:54.568 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:54.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:02:54.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-17T23:02:54.667 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:54.664+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:54.722 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:54.722 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:54.731 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:02:54.772 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:54.770+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:54.806 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-17T23:02:54.868 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:54.866+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:54.874 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:54.875 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:54.883 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:02:54.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-17T23:02:54.969 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:54.966+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:54.989 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:54.989 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:54.997 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:02:55.081 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:55.079+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:55.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-17T23:02:55.142 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:55.142 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:55.150 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:02:55.192 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:55.189+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:55.219 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:02:55.267 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:02:55.279 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:55.276+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:55.295 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:55.295 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:55.304 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:55.360 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:55.361 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:55.361 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:55.373 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:55.371+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:55.385 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:55.385 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:55.404 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:55.404 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:55.422 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:55.422 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:55.440 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:55.440 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:55.458 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:55.458 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:55.458 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:55.460 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:55.469 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:55.473 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:55.471+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:55.479 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:55.479 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:55.482 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:55.483 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:55.574 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:55.572+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:55.588 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:55.588 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:55.588 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:55.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:55.675 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:55.672+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.285338267, 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:02:55.709 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:02:55.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:02:55.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.284891354999999, 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.714 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:02:55.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.268212714000001, 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:02:55.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:02:55.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.722 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.267659043999998, 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.723 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.724 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:02:55.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:02:55.726 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.267047419999997, 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:02:55.729 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.730 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.731 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:02:55.732 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.266394720999998, 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.733 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:02:55.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.265858581000003, 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:02:55.737 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:02:55.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.741 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:02:55.742 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.251055383999997, 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:02:55.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:02:55.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:02:55.746 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.250712700999998, 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:02:55.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:02:55.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.750 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.250143315999999, 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:55.752 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.754 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.247663133000003, 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:02:55.756 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:02:55.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.759 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.240159667, 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.761 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.762 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:02:55.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.765 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.239658222000003, 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:02:55.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.768 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:02:55.769 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:55.770 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.237022500999998, 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.771 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:02:55.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:02:55.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.229164830000002, 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:02:55.776 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.777 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.779 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 34.091059006000002, 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:02:55.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 33.681756606, 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:02:55.784 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:02:55.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 33.680242219999997, 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:02:55.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.793 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 33.176408727000002, 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:02:55.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.798 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 33.171007607, 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:55.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:02:55.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:02:55.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:02:55.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:55.803 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:55.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:55.805 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:55.802+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:55.906 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:55.903+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:55.955 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:55.956 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:55.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:56.006 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:56.004+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:56.108 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:56.106+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:56.114 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:56.114 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:56.114 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:56.114 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:56.123 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:56.208 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:56.206+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 29.994368402999999, 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:02:56.235 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:02:56.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:56.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:56.240 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:02:56.240 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:02:56.240 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:56.245 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:02:56.310 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:56.308+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:56.655 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:56.655 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:02:56.655 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:56.656 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:56.657 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:56.654+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:56.757 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:56.755+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:56.767 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:56.767 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:02:56.767 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:02:56.767 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:02:56.767 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:56.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:56.861 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:56.859+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:56.924 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:02:56.924 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:02:56.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:02:56.924 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:02:56.924 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:02:56.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:56.977 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:56.975+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:57.049 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:57.049 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:57.049 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:57.049 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:57.058 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:57.099 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:02:57.097+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:02:57.160 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:57.158+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:57.203 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:57.203 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:57.203 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:57.203 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:57.203 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:57.211 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:02:57.261 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:57.259+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:57.315 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:02:57.315 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:57.323 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:02:57.362 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:57.359+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:57.427 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:57.427 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:57.427 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:02:57.427 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:57.435 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:02:57.480 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:57.478+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:57.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:02:57.538 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:57.538 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:57.538 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:57.539 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:02:57.539 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:57.548 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:02:57.564 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:57.562+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:57.614 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:57.614 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:57.615 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:57.632 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:57.632 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:57.648 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:57.648 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:57.665 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:57.663+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:57.679 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:57.679 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:57.693 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:57.693 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:02:57.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:02:57.693 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:02:57.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.693 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.454767432000001, 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:02:57.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:02:57.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:02:57.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:02:57.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.451026149, 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.700 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:02:57.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.446163533, 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:57.704 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:02:57.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:02:57.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.445731544000001, 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:57.708 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:02:57.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:02:57.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:02:57.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.453265469000002, 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:57.712 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:02:57.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:02:57.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:02:57.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:02:57.718 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.450119684000001, 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:02:57.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:57.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:57.722 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.447390544000001, 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:02:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:02:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.443967718, 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:02:57.729 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:02:57.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:02:57.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:02:57.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:02:57.733 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:57.734 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:57.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:57.735 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:57.735 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:02:57.735 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:57.736 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:57.736 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:57.736 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:57.780 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:57.778+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:57.839 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:57.839 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:57.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:02:57.888 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:57.886+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:57.969 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:57.966+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:57.990 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:57.990 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:58.000 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:02:58.070 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:58.068+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:58.103 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:58.103 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:58.112 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:02:58.171 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:58.169+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:58.256 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:58.256 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:58.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:02:58.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:02:58.308 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:58.306+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:58.367 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:58.367 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:58.372 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:58.370+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:58.376 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:02:58.474 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:58.471+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:58.520 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:58.520 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:58.529 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:02:58.574 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:58.572+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:58.639 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:58.639 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:58.648 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:02:58.689 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:58.687+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:58.776 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:58.774+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:58.798 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:58.798 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:58.807 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:02:58.876 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:02:58.874+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:02:58.924 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:58.924 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:58.933 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:02:58.977 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:58.975+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:59.041 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:59.041 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:59.050 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:02:59.091 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:59.089+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:59.178 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:59.176+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:59.210 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:59.210 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:59.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:02:59.271 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:02:59.280 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:59.277+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:59.371 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:59.371 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:59.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:02:59.381 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:02:59.379+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:02:59.482 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:02:59.480+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:02:59.488 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:59.488 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:59.497 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:02:59.583 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:02:59.581+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:02:59.605 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:59.605 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:59.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:02:59.685 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:59.682+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:59.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:02:59.765 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:59.765 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:59.775 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:02:59.816 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:59.814+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:59.864 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:02:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:02:59.864 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:02:59.882 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:02:59.882 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:02:59.884 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:02:59.884 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:02:59.886 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:02:59.884+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:02:59.893 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:02:59.899 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:02:59.899 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:02:59.916 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:02:59.917 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:02:59.933 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:02:59.933 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:02:59.953 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:02:59.954 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:02:59.975 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:02:59.975 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:02:59.979 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:02:59.979 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:02:59.987 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:02:59.985+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:02:59.999 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:02:59.999 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:02:59.999 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:02:59.999 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:00.000 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:00.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:00.093 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:00.091+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:00.152 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:00.152 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:00.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:00.153 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:00.153 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:00.161 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:00.202 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:00.200+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:00.280 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-17T23:03:00.280 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:03:00.280 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-17T23:03:00.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-17T23:03:00.289 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:00.287+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:00.305 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:00.305 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:00.305 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:00.306 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:00.314 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:00.398 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:00.396+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:00.459 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:00.459 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:00.459 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:00.459 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:00.459 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:00.467 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:00.491 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:00.489+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:00.586 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-17T23:03:00.584+0000 7fcae0ef7640 -1 mon.a@0(leader).osd e32 definitely_dead 0 2024-09-17T23:03:00.591 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:00.589+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:00.612 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:00.612 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:00.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:00.612 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:00.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.612 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:00.612 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 34.373500524999997, 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:00.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:00.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:00.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 34.369759242000001, 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:00.619 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:03:00.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:03:00.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:00.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 34.364896625999997, 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:00.623 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:03:00.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:00.627 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 34.364464636999998, 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:00.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:00.631 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 33.371998562000002, 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:00.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:00.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:00.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 33.368852777000001, 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:03:00.638 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:00.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.366123637000001, 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:00.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:00.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:00.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:00.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.362700811000003, 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:00.649 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:00.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:00.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:00.653 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:00.654 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:00.692 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:00.689+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:00.793 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:00.791+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:00.797 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:00.797 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:00.797 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:00.797 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:00.805 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:00.894 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:00.892+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:00.908 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:00.908 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:00.908 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:00.908 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:00.908 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:00.916 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:01.000 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:00.998+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:01.058 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:01.059 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:01.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:01.059 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:01.059 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:01.067 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:03:01.108 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:01.106+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:01.196 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:01.194+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:01.211 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:01.211 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:01.211 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:01.211 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:01.219 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:03:01.276 INFO:teuthology.orchestra.run.smithi005.stderr:marked in osd.4. 2024-09-17T23:03:01.288 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:03:01.291 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-17T23:03:01.303 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:01.301+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:01.364 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:01.364 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:01.364 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:01.364 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:01.364 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:01.373 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:03:01.398 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:01.396+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:01.501 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:01.498+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:01.517 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:01.517 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:01.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:01.517 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.302378714, 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.188649542, 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:01.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212078+0000", 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.669e-06 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212092+0000", 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4959e-05 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212105+0000", 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2283000000000001e-05 2024-09-17T23:03:01.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212114+0000", 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8990000000000007e-06 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212177+0000", 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3533000000000003e-05 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212187+0000", 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4790000000000002e-06 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399184+0000", 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.18699711599999999 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399382+0000", 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019809299999999999 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399604+0000", 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00022205 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400259+0000", 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065476499999999997 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400634+0000", 2024-09-17T23:03:01.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00037537600000000002 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400675+0000", 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1291999999999997e-05 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400725+0000", 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0028000000000003e-05 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:21 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 65536~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.094158423000003, 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076785070000000002, 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.525 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 21 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420297+0000", 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.54e-07 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420377+0000", 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9809999999999997e-05 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420387+0000", 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0026e-05 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420391+0000", 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5510000000000001e-06 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420833+0000", 2024-09-17T23:03:01.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044210300000000001 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420887+0000", 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3324e-05 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420973+0000", 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6428999999999995e-05 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422150+0000", 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011773039999999999 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427781+0000", 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056303120000000002 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427900+0000", 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000118769 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427975+0000", 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5124999999999996e-05 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:22 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.531 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.094049581, 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0077273339999999998, 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 22 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420406+0000", 2024-09-17T23:03:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4000000000000001e-07 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420410+0000", 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5789999999999997e-06 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420417+0000", 2024-09-17T23:03:01.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8900000000000001e-06 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420423+0000", 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7679999999999997e-06 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421317+0000", 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00089395000000000002 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421370+0000", 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3492999999999998e-05 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421455+0000", 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4351000000000006e-05 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422372+0000", 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091742899999999999 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427997+0000", 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056245289999999996 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428104+0000", 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106944 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428132+0000", 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8761000000000001e-05 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.896430545999998, 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063598999999999999, 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.538 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 110 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618025+0000", 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8400000000000004e-07 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618029+0000", 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1489999999999996e-06 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618037+0000", 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0979999999999994e-06 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618047+0000", 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0247e-05 2024-09-17T23:03:01.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622380+0000", 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043329900000000001 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622456+0000", 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6040999999999999e-05 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622592+0000", 2024-09-17T23:03:01.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013632600000000001 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624289+0000", 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696737 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624301+0000", 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2099000000000001e-05 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624346+0000", 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4634e-05 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624384+0000", 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7994999999999998e-05 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.544 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.896380774999997, 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0064380779999999999, 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 111 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9699999999999996e-07 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.547 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.547 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618078+0000", 2024-09-17T23:03:01.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.811e-06 2024-09-17T23:03:01.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618092+0000", 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.413e-05 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618103+0000", 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0232e-05 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623161+0000", 2024-09-17T23:03:01.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050586880000000004 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623220+0000", 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8449000000000002e-05 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623293+0000", 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3139000000000006e-05 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624390+0000", 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00109734 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624455+0000", 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4478000000000002e-05 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624489+0000", 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3853000000000003e-05 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624512+0000", 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3360999999999999e-05 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.896334699000001, 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0074594789999999998, 2024-09-17T23:03:01.552 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 112 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618121+0000", 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7000000000000004e-07 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618204+0000", 2024-09-17T23:03:01.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3512999999999998e-05 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618213+0000", 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2359999999999993e-06 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618219+0000", 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1770000000000003e-06 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623528+0000", 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053089269999999997 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623604+0000", 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5462000000000004e-05 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623734+0000", 2024-09-17T23:03:01.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013053399999999999 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625477+0000", 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001742653 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625492+0000", 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4825e-05 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625539+0000", 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7033999999999997e-05 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625579+0000", 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0448000000000003e-05 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.558 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.896222657000003, 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0082098180000000007, 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 113 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.559 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618233+0000", 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1200000000000003e-07 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618240+0000", 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2989999999999999e-06 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618247+0000", 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.542e-06 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618252+0000", 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8010000000000003e-06 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624556+0000", 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063039050000000003 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624641+0000", 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4456999999999995e-05 2024-09-17T23:03:01.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624763+0000", 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000122917 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625627+0000", 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086396699999999999 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626341+0000", 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00071333799999999999 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626391+0000", 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0192999999999999e-05 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626442+0000", 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0787e-05 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.896194624000003, 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0087386709999999999, 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.565 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 114 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3799999999999998e-07 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618263+0000", 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8820000000000001e-06 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618267+0000", 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0840000000000002e-06 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618271+0000", 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8449999999999996e-06 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625074+0000", 2024-09-17T23:03:01.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068027599999999997 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625121+0000", 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6805999999999999e-05 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625206+0000", 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5538999999999995e-05 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626903+0000", 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696454 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626916+0000", 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3634e-05 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626962+0000", 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5357e-05 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626999+0000", 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6971999999999998e-05 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.896175626999998, 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093097030000000008, 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.571 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 115 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.27e-07 2024-09-17T23:03:01.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618326+0000", 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6261999999999999e-05 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618331+0000", 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0889999999999999e-06 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618334+0000", 2024-09-17T23:03:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.23e-06 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625664+0000", 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0073300989999999996 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625739+0000", 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5535000000000001e-05 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625882+0000", 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014275299999999999 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627033+0000", 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001151116 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627506+0000", 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047273299999999997 2024-09-17T23:03:01.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627550+0000", 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4189e-05 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627589+0000", 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.837e-05 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.896112047000003, 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093607020000000003, 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 116 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.578 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:03:01.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9299999999999998e-07 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618347+0000", 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.664e-06 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618351+0000", 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3359999999999997e-06 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618354+0000", 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8540000000000001e-06 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626489+0000", 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0081350580000000006 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626538+0000", 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9490999999999998e-05 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626617+0000", 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8404000000000004e-05 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627611+0000", 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00099458599999999999 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627624+0000", 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2598e-05 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627668+0000", 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3501000000000002e-05 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627703+0000", 2024-09-17T23:03:01.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5716999999999997e-05 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.896095778999999, 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.009520489, 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.584 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 117 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:03:01.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2399999999999999e-07 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618361+0000", 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1059999999999998e-06 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618365+0000", 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6150000000000001e-06 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618367+0000", 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6790000000000001e-06 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627063+0000", 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0086957619999999992 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627146+0000", 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2879000000000004e-05 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627287+0000", 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014122700000000001 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627757+0000", 2024-09-17T23:03:01.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000470066 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627820+0000", 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.279e-05 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627856+0000", 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5463999999999998e-05 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627879+0000", 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3677e-05 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.491038322999998, 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0075600570000000002, 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.590 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 137 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023417+0000", 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8599999999999998e-07 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023466+0000", 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8794000000000001e-05 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023474+0000", 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7139999999999999e-06 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023480+0000", 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8019999999999997e-06 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027360+0000", 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038796270000000001 2024-09-17T23:03:01.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027440+0000", 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0753000000000004e-05 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027519+0000", 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8203999999999999e-05 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028755+0000", 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012362790000000001 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030928+0000", 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021728120000000001 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030954+0000", 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5910000000000001e-05 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030976+0000", 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2676000000000001e-05 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.490957236, 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076214569999999999, 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.596 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 138 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023498+0000", 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8800000000000002e-07 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023503+0000", 2024-09-17T23:03:01.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3669999999999996e-06 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023510+0000", 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7889999999999997e-06 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023519+0000", 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.098e-06 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028869+0000", 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053500609999999997 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028946+0000", 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6508999999999995e-05 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029084+0000", 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013776700000000001 2024-09-17T23:03:01.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030981+0000", 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001897971 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031025+0000", 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3883e-05 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031079+0000", 2024-09-17T23:03:01.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3325999999999997e-05 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031119+0000", 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0098000000000001e-05 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.490926223999999, 2024-09-17T23:03:01.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076808450000000004, 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 139 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023529+0000", 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023532+0000", 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.456e-06 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023539+0000", 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6540000000000002e-06 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023544+0000", 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1529999999999996e-06 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029398+0000", 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0058541829999999998 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029444+0000", 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5605999999999997e-05 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029521+0000", 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6689999999999999e-05 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031156+0000", 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0016352700000000001 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031163+0000", 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9269999999999999e-06 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031187+0000", 2024-09-17T23:03:01.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4235000000000001e-05 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031209+0000", 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.213e-05 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.490899063000001, 2024-09-17T23:03:01.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0078442649999999996, 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 140 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:03:01.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0200000000000002e-07 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023622+0000", 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6181999999999998e-05 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023631+0000", 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5750000000000001e-06 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023638+0000", 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4630000000000004e-06 2024-09-17T23:03:01.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029770+0000", 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0061317089999999999 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029845+0000", 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5439999999999996e-05 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029968+0000", 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012251800000000001 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031244+0000", 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012764359999999999 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031339+0000", 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4217999999999998e-05 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031380+0000", 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1258999999999999e-05 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031400+0000", 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9962999999999998e-05 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.614 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.490802479000003, 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0085476930000000003, 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 141 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023653+0000", 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6499999999999999e-07 2024-09-17T23:03:01.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023657+0000", 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0400000000000003e-06 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023664+0000", 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1790000000000002e-06 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023669+0000", 2024-09-17T23:03:01.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3029999999999999e-06 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030600+0000", 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069304589999999999 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030647+0000", 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7354000000000001e-05 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030718+0000", 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1116000000000001e-05 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031458+0000", 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00074007599999999999 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032158+0000", 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069986799999999997 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032181+0000", 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2832000000000001e-05 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032200+0000", 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8800999999999998e-05 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.620 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.982092909999999, 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068810570000000003, 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 156 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8999999999999997e-07 2024-09-17T23:03:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532365+0000", 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0079999999999998e-06 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532371+0000", 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1369999999999999e-06 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532378+0000", 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.443e-06 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533797+0000", 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0014196530000000001 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533838+0000", 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0629e-05 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533916+0000", 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8107000000000003e-05 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535288+0000", 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001372123 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539185+0000", 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038971600000000002 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539219+0000", 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3905000000000001e-05 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539243+0000", 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3402000000000001e-05 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.982069174999999, 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069027610000000003, 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 157 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532386+0000", 2024-09-17T23:03:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5999999999999999e-07 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532393+0000", 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8929999999999999e-06 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532398+0000", 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6869999999999999e-06 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532407+0000", 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8270000000000004e-06 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534365+0000", 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0019577510000000002 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534418+0000", 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2936000000000003e-05 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534482+0000", 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4212000000000001e-05 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535659+0000", 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011769230000000001 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539247+0000", 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0035881020000000001 2024-09-17T23:03:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539269+0000", 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1807e-05 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539288+0000", 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9162999999999999e-05 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.982035934999999, 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.006929943, 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 158 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:03:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5300000000000004e-07 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532590+0000", 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017035600000000001 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532598+0000", 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4009999999999997e-06 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532604+0000", 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9209999999999997e-06 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534755+0000", 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021515750000000002 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534795+0000", 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9229e-05 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534866+0000", 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1607999999999996e-05 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535934+0000", 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001068049 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539293+0000", 2024-09-17T23:03:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033591300000000001 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539328+0000", 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4715999999999998e-05 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539349+0000", 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0404999999999999e-05 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.981840015000003, 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0067798900000000002, 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 159 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1999999999999999e-07 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532619+0000", 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6859999999999999e-06 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532626+0000", 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3810000000000001e-06 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532632+0000", 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7049999999999996e-06 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535305+0000", 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0026735190000000001 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535345+0000", 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9313000000000001e-05 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535408+0000", 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3072999999999997e-05 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.536170+0000", 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076224300000000001 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539352+0000", 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0031817310000000001 2024-09-17T23:03:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539376+0000", 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3743e-05 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539394+0000", 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8876e-05 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:01.645 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:01.645 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:01.647 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:01.645+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:01.748 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:01.746+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:01.757 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:01.757 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:01.757 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:01.757 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:01.766 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:01.851 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:01.849+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:01.915 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:01.915 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:01.915 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:01.915 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:01.915 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:01.923 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:01.950 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:01.948+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:01.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:02.051 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:02.050+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:02.076 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.651994410999997, 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.077 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:02.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.651547499000003, 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:02.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:02.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.634868857999997, 2024-09-17T23:03:02.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:02.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.634315188000002, 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.091 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:02.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.633703564000001, 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.096 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.633050865000001, 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.632514725, 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:02.105 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:02.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.109 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.617711528000001, 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:02.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:02.114 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.617368845000001, 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:02.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:02.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.616799460000003, 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:02.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.614319277, 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:02.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:02.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.128 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.606815810999997, 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:02.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:02.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.606314365999999, 2024-09-17T23:03:02.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:02.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.603678645000002, 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:02.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:02.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:02.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.595820973999999, 2024-09-17T23:03:02.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:02.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:02.146 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.457715149999999, 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:02.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:02.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:02.151 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.048412749999997, 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:02.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 40.046898364, 2024-09-17T23:03:02.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:02.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:02.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 39.543064870999999, 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.161 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:02.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 39.537663750999997, 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:02.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:02.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:02.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:02.170 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:02.170 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:02.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:02.172 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:02.172 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:02.173 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:02.173 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:02.174 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:02.174 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:02.174 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:02.169+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:02.190 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:02.190 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:02.222 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:02.222 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:02.250 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:02.250 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:02.267 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:03:02.267 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:03:02.270 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:02.271 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:02.272 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:02.270+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:02.285 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:03:02.292 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:02.292 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:02.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:02.373 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:02.371+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:02.464 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:02.465 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:02.474 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:02.472+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:02.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:02.574 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:02.572+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:02.587 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:02.587 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:02.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:02.675 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:02.674+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:02.745 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:02.745 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:02.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:02.797 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:02.795+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:02.862 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:02.862 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:02.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:02.877 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:02.875+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:02.977 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:02.975+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:03.022 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:03.022 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:03.031 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:03.078 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:03.076+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:03.146 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:03.146 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:03.155 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:03.179 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:03.177+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:03.257 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:03.257 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:03.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:03.280 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:03.277+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:03.369 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:03.369 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:03.378 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:03.380 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:03.378+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:03.481 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:03.481 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:03.481 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:03.479+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:03.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:03.582 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:03.579+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:03.593 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:03.594 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:03.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:03.683 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:03.681+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:03.706 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:03.706 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:03.715 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:03.799 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:03.797+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:03.859 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:03.859 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:03.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:03.884 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:03.882+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:03.985 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:03.983+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:04.011 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:04.011 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:04.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:04.086 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:04.084+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:04.123 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:04.123 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:04.132 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:03:04.216 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:04.214+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:04.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:04.275 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:04.275 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:04.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:03:04.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:03:04.324 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:04.322+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:04.390 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:04.387+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:04.426 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:04.426 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:04.435 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:03:04.465 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:04.498 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:04.520 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:04.518+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:04.529 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:04.530 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:04.560 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:04.561 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:04.580 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:04.580 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:04.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:04.590 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:04.591 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:04.621 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:04.621 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:04.630 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:04.628+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:04.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:03:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:03:04.658 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:04.659 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:04.692 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:04.690+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:04.712 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:04.712 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:04.712 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:04.712 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:04.721 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:04.793 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:04.791+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:04.859 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:04.859 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:04.859 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:04.859 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:04.859 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:04.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:04.894 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:04.892+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:04.994 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:04.992+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.58124961, 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:05.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.580802697999999, 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.010 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:05.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:05.013 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.564124057000001, 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:05.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:05.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:05.018 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.563570386999999, 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.019 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:05.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.562958762999997, 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.023 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:05.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:05.026 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.562306063999998, 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:05.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.030 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.561769924000004, 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:05.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:05.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.546966726999997, 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:05.036 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:05.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:05.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.546624043999998, 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:05.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:05.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:05.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.546054658999999, 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.543574476000003, 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.049 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:05.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:05.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:05.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.536071010000001, 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:05.053 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.054 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:05.057 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.535569565000003, 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:05.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.061 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.532933843999999, 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:05.063 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.064 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.525076173000002, 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.066 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.067 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:05.069 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 43.386970349000002, 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.071 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.074 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 42.977667949000001, 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:05.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 42.976153562999997, 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:05.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 42.472320070000002, 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.083 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:05.087 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 42.46691895, 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:05.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:05.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:05.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.091 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.092 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:05.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:05.096 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:05.094+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:05.196 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:05.194+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:05.222 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:05.222 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:05.222 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:05.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:05.288 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:03:05.297 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:05.294+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:05.371 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:05.371 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:05.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:05.398 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:05.395+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 39.248303483999997, 2024-09-17T23:03:05.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:05.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:05.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.493 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.494 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.494 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:05.494 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:05.494 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:05.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:05.499 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:05.496+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:05.599 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:05.596+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:05.639 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:05.639 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:05.639 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:05.639 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:05.651 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:05.700 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:05.698+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:05.801 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:05.799+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:05.801 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:05.801 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:05.801 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:05.801 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:05.801 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:05.810 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:05.902 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:05.900+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:05.932 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:05.932 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:05.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:05.933 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:05.933 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:05.942 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:06.003 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:06.001+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:06.058 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:06.058 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:06.058 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:06.058 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:06.067 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:06.104 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:06.102+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:06.170 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:06.170 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:06.170 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:06.171 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:06.171 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:06.179 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:06.222 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:06.220+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:06.282 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:06.282 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:06.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:06.282 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:06.282 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:06.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:06.292 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-17T23:03:06.292 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:03:06.292 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T23:03:06.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T23:03:06.336 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:06.334+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:06.408 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:06.405+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:06.433 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:06.434 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:06.434 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:06.434 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:06.442 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:06.509 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:06.507+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:06.544 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:06.545 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:06.545 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:06.545 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:06.545 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:06.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:06.609 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:06.607+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:06.658 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:06.658 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:06.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:06.658 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:06.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.658 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.419699377999997, 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:06.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.415958095000001, 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:03:06.665 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:03:06.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:03:06.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.411095478999997, 2024-09-17T23:03:06.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:03:06.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:06.673 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.410663489999997, 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:06.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:03:06.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.418197415000002, 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:06.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:06.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:06.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:06.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.415051630000001, 2024-09-17T23:03:06.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:03:06.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:03:06.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.412322490000001, 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:06.688 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:06.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:06.694 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.408899664000003, 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:03:06.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:03:06.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:03:06.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:03:06.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.699 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:06.699 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:06.699 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:06.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:06.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:06.702 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:03:06.702 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:06.702 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 35, 2024-09-17T23:03:06.702 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "4cb0491c-5273-43ce-9711-0f68bec58f2e", 2024-09-17T23:03:06.702 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-09-17T23:02:05.418126+0000", 2024-09-17T23:03:06.702 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-09-17T23:03:05.285805+0000", 2024-09-17T23:03:06.702 INFO:teuthology.orchestra.run.smithi005.stdout: "last_up_change": "2024-09-17T23:02:35.199497+0000", 2024-09-17T23:03:06.702 INFO:teuthology.orchestra.run.smithi005.stdout: "last_in_change": "2024-09-17T23:03:01.271643+0000", 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_num": 5804032, 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_set": [ 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "nodeep-scrub", 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "pglog_hardlimit", 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "purged_snapdirs", 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_deletes", 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "sortbitwise" 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_version": 4, 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_snapshot": "", 2024-09-17T23:03:06.703 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_max": 2, 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd": 8, 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "require_min_compat_client": "luminous", 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "min_compat_client": "jewel", 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "require_osd_release": "squid", 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_crimson": false, 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": [ 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 1, 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": ".mgr", 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:19.615759+0000", 2024-09-17T23:03:06.704 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool", 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 1, 2024-09-17T23:03:06.705 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 1, 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 1, 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 1, 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 1, 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "17", 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:03:06.706 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 0, 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 0, 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:03:06.707 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:03:06.708 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "options": { 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_max": 32, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_min": 1 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.709 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": {} 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 8, 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 8, 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.25, 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 2, 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 2, 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 1, 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 1, 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 1 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 2, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": "rbd", 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:24.412869+0000", 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 8193, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:03:06.711 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 8, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 8, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 8, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 8, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 8, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:03:06.712 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "21", 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 2, 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 21, 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:03:06.713 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:03:06.714 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:03:06.715 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "options": {}, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd": {} 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 2, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 2, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.75, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 1.5, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 1.5, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 1, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 1, 2024-09-17T23:03:06.716 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 1 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "69fa22ee-5c14-4f80-82fe-b22939183e4a", 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:06.717 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-17T23:03:06.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6802", 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6803", 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6806", 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6807", 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6804", 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6805", 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6801/3261733059", 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6803/3261733059", 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6807/3261733059", 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6805/3261733059", 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:06.722 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "a50256db-895f-4a6b-b83e-e251a3b53e10", 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 18, 2024-09-17T23:03:06.723 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 22, 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6816", 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6817", 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6818", 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6819", 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6822", 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:06.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6823", 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6820", 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:06.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6821", 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6817/3745424715", 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6819/3745424715", 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6823/3745424715", 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6821/3745424715", 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:06.728 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2", 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:06.729 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 18, 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6824", 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6825", 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:06.730 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6826", 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6827", 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6830", 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6831", 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6828", 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6829", 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6825/3492189306", 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6827/3492189306", 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6831/3492189306", 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6829/3492189306", 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "b9664ac0-db52-42bb-aa10-9ad23cc7021a", 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 0, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:06.735 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6808", 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6809", 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6810", 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6811", 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:06.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6814", 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6815", 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.738 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6812", 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6813", 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6809/1475101831", 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6811/1475101831", 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6815/1475101831", 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6813/1475101831", 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:03:06.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "5a11b2ff-7a67-40ed-8076-90ce187a3d96", 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 0, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6810", 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6811", 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:06.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6812", 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6813", 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:06.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6816", 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6817", 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:06.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6814", 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6815", 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.745 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6811/1406375140", 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6813/1406375140", 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6817/1406375140", 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6815/1406375140", 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "2361e4e6-f10b-417b-a976-a037ac890e11", 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:06.746 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6818", 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:06.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6819", 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6820", 2024-09-17T23:03:06.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6821", 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6824", 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6825", 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6822", 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6823", 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6819/2095030613", 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6821/2095030613", 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6825/2095030613", 2024-09-17T23:03:06.751 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6823/2095030613", 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "8d3a457f-9981-4307-ac8e-4d45f1600ade", 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:06.752 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6802", 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6803", 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6804", 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6805", 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6808", 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6809", 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6806", 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:06.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6807", 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6803/3030792595", 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6805/3030792595", 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6809/3030792595", 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6807/3030792595", 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:06.757 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3", 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:06.758 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6826", 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6827", 2024-09-17T23:03:06.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6828", 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6829", 2024-09-17T23:03:06.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6832", 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6833", 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6830", 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.762 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6831", 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6827/967279289", 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6829/967279289", 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6833/967279289", 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6831/967279289", 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:06.763 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_xinfo": [ 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.899917+0000", 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.157860+0000", 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 22 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:06.765 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.416164+0000", 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:06.766 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.907974+0000", 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.523463+0000", 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.326314+0000", 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.363775+0000", 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.492325+0000", 2024-09-17T23:03:06.769 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap": [], 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_items": [], 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_primaries": [], 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_temp": [], 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_temp": [], 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklist": {}, 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "range_blocklist": {}, 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profiles": { 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "default": { 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-failure-domain": "osd", 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "k": "2", 2024-09-17T23:03:06.770 INFO:teuthology.orchestra.run.smithi005.stdout: "m": "1", 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin": "jerasure", 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "technique": "reed_sol_van" 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps_queue": [], 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "new_removed_snaps": [], 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "new_purged_snaps": [], 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_node_flags": {}, 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "device_class_flags": {}, 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": { 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_enabled": false, 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_bucket_count": 0, 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "degraded_stretch_mode": 0, 2024-09-17T23:03:06.771 INFO:teuthology.orchestra.run.smithi005.stdout: "recovering_stretch_mode": 0, 2024-09-17T23:03:06.772 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_bucket": 0 2024-09-17T23:03:06.772 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:06.772 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:06.773 INFO:tasks.thrashosds.thrasher:j is {'epoch': 35, 'fsid': '4cb0491c-5273-43ce-9711-0f68bec58f2e', 'created': '2024-09-17T23:02:05.418126+0000', 'modified': '2024-09-17T23:03:05.285805+0000', 'last_up_change': '2024-09-17T23:02:35.199497+0000', 'last_in_change': '2024-09-17T23:03:01.271643+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T23:02:19.615759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T23:02:24.412869+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '69fa22ee-5c14-4f80-82fe-b22939183e4a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6800', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6801', 'nonce': 3261733059}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6802', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6803', 'nonce': 3261733059}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6806', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6807', 'nonce': 3261733059}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6804', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6805', 'nonce': 3261733059}]}, 'public_addr': '172.21.15.5:6801/3261733059', 'cluster_addr': '172.21.15.5:6803/3261733059', 'heartbeat_back_addr': '172.21.15.5:6807/3261733059', 'heartbeat_front_addr': '172.21.15.5:6805/3261733059', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a50256db-895f-4a6b-b83e-e251a3b53e10', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 22, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6816', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6817', 'nonce': 3745424715}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6818', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6819', 'nonce': 3745424715}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6822', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6823', 'nonce': 3745424715}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6820', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6821', 'nonce': 3745424715}]}, 'public_addr': '172.21.15.5:6817/3745424715', 'cluster_addr': '172.21.15.5:6819/3745424715', 'heartbeat_back_addr': '172.21.15.5:6823/3745424715', 'heartbeat_front_addr': '172.21.15.5:6821/3745424715', 'state': ['exists']}, {'osd': 2, 'uuid': 'c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6824', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6825', 'nonce': 3492189306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6826', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6827', 'nonce': 3492189306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6830', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6831', 'nonce': 3492189306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6828', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6829', 'nonce': 3492189306}]}, 'public_addr': '172.21.15.5:6825/3492189306', 'cluster_addr': '172.21.15.5:6827/3492189306', 'heartbeat_back_addr': '172.21.15.5:6831/3492189306', 'heartbeat_front_addr': '172.21.15.5:6829/3492189306', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'b9664ac0-db52-42bb-aa10-9ad23cc7021a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6808', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6809', 'nonce': 1475101831}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6810', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6811', 'nonce': 1475101831}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6814', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6815', 'nonce': 1475101831}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6812', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6813', 'nonce': 1475101831}]}, 'public_addr': '172.21.15.5:6809/1475101831', 'cluster_addr': '172.21.15.5:6811/1475101831', 'heartbeat_back_addr': '172.21.15.5:6815/1475101831', 'heartbeat_front_addr': '172.21.15.5:6813/1475101831', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5a11b2ff-7a67-40ed-8076-90ce187a3d96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6810', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6811', 'nonce': 1406375140}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6812', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6813', 'nonce': 1406375140}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6816', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6817', 'nonce': 1406375140}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6814', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6815', 'nonce': 1406375140}]}, 'public_addr': '172.21.15.152:6811/1406375140', 'cluster_addr': '172.21.15.152:6813/1406375140', 'heartbeat_back_addr': '172.21.15.152:6817/1406375140', 'heartbeat_front_addr': '172.21.15.152:6815/1406375140', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2361e4e6-f10b-417b-a976-a037ac890e11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6818', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6819', 'nonce': 2095030613}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6820', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6821', 'nonce': 2095030613}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6824', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6825', 'nonce': 2095030613}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6822', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6823', 'nonce': 2095030613}]}, 'public_addr': '172.21.15.152:6819/2095030613', 'cluster_addr': '172.21.15.152:6821/2095030613', 'heartbeat_back_addr': '172.21.15.152:6825/2095030613', 'heartbeat_front_addr': '172.21.15.152:6823/2095030613', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8d3a457f-9981-4307-ac8e-4d45f1600ade', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6802', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6803', 'nonce': 3030792595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6804', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6805', 'nonce': 3030792595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6808', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6809', 'nonce': 3030792595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6806', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6807', 'nonce': 3030792595}]}, 'public_addr': '172.21.15.152:6803/3030792595', 'cluster_addr': '172.21.15.152:6805/3030792595', 'heartbeat_back_addr': '172.21.15.152:6809/3030792595', 'heartbeat_front_addr': '172.21.15.152:6807/3030792595', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6826', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6827', 'nonce': 967279289}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6828', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6829', 'nonce': 967279289}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 967279289}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6830', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6831', 'nonce': 967279289}]}, 'public_addr': '172.21.15.152:6827/967279289', 'cluster_addr': '172.21.15.152:6829/967279289', 'heartbeat_back_addr': '172.21.15.152:6833/967279289', 'heartbeat_front_addr': '172.21.15.152:6831/967279289', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.899917+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.157860+0000', 'dead_epoch': 22}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.416164+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.907974+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.523463+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.326314+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.363775+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.492325+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T23:03:06.773 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:03:06.775 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:06.772+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:06.876 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:06.873+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:06.879 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:06.879 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:06.880 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:06.880 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:06.886 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:06.949 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:06.949 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:06.950 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:06.977 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:06.974+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:06.984 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:06.985 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:06.989 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:06.989 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:06.989 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:06.989 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:06.990 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:06.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:07.016 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:07.016 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:07.049 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:07.049 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:07.077 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:07.075+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:07.083 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:07.084 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:07.113 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:07.113 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:07.129 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:03:07.130 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:03:07.133 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:07.133 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:07.142 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:07.142 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:07.151 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:03:07.195 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:07.193+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:07.254 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:03:07.254 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:03:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:07.255 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:07.262 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:03:07.267 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-17T23:03:05.577022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":14,"acting":14,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":236840,"kb_used_data":3956,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737880,"statfs":{"total":773094113280,"available":772851589120,"internally_reserved":0,"allocated":4050944,"data_stored":2264042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000991"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T23:03:02.341467+0000","last_change":"2024-09-17T23:02:28.242504+0000","last_active":"2024-09-17T23:03:02.341467+0000","last_peered":"2024-09-17T23:03:02.341467+0000","last_clean":"2024-09-17T23:03:02.341467+0000","last_became_active":"2024-09-17T23:02:26.239779+0000","last_became_peered":"2024-09-17T23:02:26.239779+0000","last_unstale":"2024-09-17T23:03:02.341467+0000","last_undegraded":"2024-09-17T23:03:02.341467+0000","last_fullsized":"2024-09-17T23:03:02.341467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:25:35.187289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-09-17T23:03:02.341464+0000","last_change":"2024-09-17T23:02:36.206501+0000","last_active":"2024-09-17T23:03:02.341464+0000","last_peered":"2024-09-17T23:03:02.341464+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.206501+0000","last_became_peered":"2024-09-17T23:02:36.206501+0000","last_unstale":"2024-09-17T23:03:02.341464+0000","last_undegraded":"2024-09-17T23:03:02.341464+0000","last_fullsized":"2024-09-17T23:02:36.205957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:14:38.209826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T23:03:02.286855+0000","last_change":"2024-09-17T23:02:28.467862+0000","last_active":"2024-09-17T23:03:02.286855+0000","last_peered":"2024-09-17T23:03:02.286855+0000","last_clean":"2024-09-17T23:03:02.286855+0000","last_became_active":"2024-09-17T23:02:26.809635+0000","last_became_peered":"2024-09-17T23:02:26.809635+0000","last_unstale":"2024-09-17T23:03:02.286855+0000","last_undegraded":"2024-09-17T23:03:02.286855+0000","last_fullsized":"2024-09-17T23:03:02.286855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:20:36.477332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000417293,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-09-17T23:03:02.341484+0000","last_change":"2024-09-17T23:02:36.205932+0000","last_active":"2024-09-17T23:03:02.341484+0000","last_peered":"2024-09-17T23:03:02.341484+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.205932+0000","last_became_peered":"2024-09-17T23:02:36.205932+0000","last_unstale":"2024-09-17T23:03:02.341484+0000","last_undegraded":"2024-09-17T23:03:02.341484+0000","last_fullsized":"2024-09-17T23:02:36.205433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:27.219119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":49,"reported_epoch":34,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:03:02.341566+0000","last_change":"2024-09-17T23:02:36.206690+0000","last_active":"2024-09-17T23:03:02.341566+0000","last_peered":"2024-09-17T23:03:02.341566+0000","last_clean":"2024-09-17T23:02:28.601103+0000","last_became_active":"2024-09-17T23:02:36.206690+0000","last_became_peered":"2024-09-17T23:02:36.206690+0000","last_unstale":"2024-09-17T23:03:02.341566+0000","last_undegraded":"2024-09-17T23:02:36.206032+0000","last_fullsized":"2024-09-17T23:02:36.205941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:18.666349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":1}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T23:03:02.341530+0000","last_change":"2024-09-17T23:02:28.242589+0000","last_active":"2024-09-17T23:03:02.341530+0000","last_peered":"2024-09-17T23:03:02.341530+0000","last_clean":"2024-09-17T23:03:02.341530+0000","last_became_active":"2024-09-17T23:02:26.238780+0000","last_became_peered":"2024-09-17T23:02:26.238780+0000","last_unstale":"2024-09-17T23:03:02.341530+0000","last_undegraded":"2024-09-17T23:03:02.341530+0000","last_fullsized":"2024-09-17T23:03:02.341530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:12:18.801672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044709600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+undersized","last_fresh":"2024-09-17T23:03:02.286855+0000","last_change":"2024-09-17T23:02:36.204438+0000","last_active":"2024-09-17T23:03:02.286855+0000","last_peered":"2024-09-17T23:03:02.286855+0000","last_clean":"2024-09-17T23:02:28.597949+0000","last_became_active":"2024-09-17T23:02:36.204438+0000","last_became_peered":"2024-09-17T23:02:36.204438+0000","last_unstale":"2024-09-17T23:03:02.286855+0000","last_undegraded":"2024-09-17T23:03:02.286855+0000","last_fullsized":"2024-09-17T23:02:36.203989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:29:19.022828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T23:03:02.341566+0000","last_change":"2024-09-17T23:02:28.245906+0000","last_active":"2024-09-17T23:03:02.341566+0000","last_peered":"2024-09-17T23:03:02.341566+0000","last_clean":"2024-09-17T23:03:02.341566+0000","last_became_active":"2024-09-17T23:02:26.238139+0000","last_became_peered":"2024-09-17T23:02:26.238139+0000","last_unstale":"2024-09-17T23:03:02.341566+0000","last_undegraded":"2024-09-17T23:03:02.341566+0000","last_fullsized":"2024-09-17T23:03:02.341566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:47:18.418218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T23:03:02.286858+0000","last_change":"2024-09-17T23:02:21.400008+0000","last_active":"2024-09-17T23:03:02.286858+0000","last_peered":"2024-09-17T23:03:02.286858+0000","last_clean":"2024-09-17T23:03:02.286858+0000","last_became_active":"2024-09-17T23:02:21.398946+0000","last_became_peered":"2024-09-17T23:02:21.398946+0000","last_unstale":"2024-09-17T23:03:02.286858+0000","last_undegraded":"2024-09-17T23:03:02.286858+0000","last_fullsized":"2024-09-17T23:03:02.286858+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:10:16.204902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":12,"acting":12,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":970752,"data_stored":734611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":376832,"data_stored":144243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":144262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":144243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":376832,"data_stored":144243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":376832,"data_stored":144243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":734611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:03:07.268 INFO:tasks.thrashosds.thrasher:Setting 2.5 to [2, 0] 2024-09-17T23:03:07.268 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.5', '2', '0'] 2024-09-17T23:03:07.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.5 2 0 2024-09-17T23:03:07.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:03:07.312 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:07.310+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:07.380 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:07.377+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:07.405 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:07.405 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:07.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:03:07.499 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:07.497+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:07.558 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:07.558 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:07.566 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:07.607 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:07.605+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:07.683 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:07.681+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:07.729 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:07.729 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:07.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:07.784 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:07.782+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:07.849 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:07.849 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:07.858 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:07.883 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:07.881+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:07.984 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:07.982+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:08.051 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:08.051 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:08.061 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:08.102 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:08.100+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:08.187 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:08.185+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:08.211 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:08.211 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:08.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:08.287 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:08.286+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:08.302 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:03:08.306 INFO:teuthology.orchestra.run.smithi005.stderr:set 2.5 pg_upmap mapping to [2,0] 2024-09-17T23:03:08.340 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:08.341 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:08.350 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:08.391 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:08.389+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:08.489 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:08.487+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:08.499 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:08.499 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:08.508 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:08.590 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:08.588+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:08.647 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:08.660 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:08.704 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:08.702+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:08.788 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:08.788 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:08.792 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:08.790+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:08.800 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:08.893 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:08.891+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:08.972 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:08.972 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:08.985 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:08.993 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:08.991+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:09.095 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:09.093+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:09.099 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:09.099 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:09.109 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:09.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:09.196 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:09.193+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:09.211 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:09.211 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:09.220 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:09.276 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:09.277 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:09.277 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:09.300 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:09.300 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:09.304 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:09.302+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:09.332 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:09.332 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:09.363 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:09.363 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:09.367 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:09.367 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:09.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:09.367 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:09.367 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:09.376 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:09.380 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:09.380 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:09.396 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:09.397 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:09.397 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:09.395+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:09.413 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:03:09.414 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:03:09.419 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:09.419 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:09.497 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:09.495+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:09.520 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:09.520 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:09.521 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:09.521 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:09.529 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:09.598 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:09.596+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:09.674 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:09.674 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:09.674 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:09.674 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:09.674 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:09.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:09.700 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:09.697+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 43.54834443, 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:09.787 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:09.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:09.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:09.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:09.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 43.544603146999997, 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.794 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:03:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:03:09.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 43.539740531, 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:03:09.798 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:03:09.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:09.802 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 43.539308542000001, 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:03:09.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 42.546842466999998, 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.807 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:09.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:09.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:09.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 42.543696681999997, 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.813 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:09.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:09.817 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.540967541999997, 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:09.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:09.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:09.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:09.824 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.537544715999999, 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:09.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:09.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4201.0:1 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.19599750399999999, 2024-09-17T23:03:09.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00023331, 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4201", 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588795+0000", 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.722e-06 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588801+0000", 2024-09-17T23:03:09.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2779999999999999e-06 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588811+0000", 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6379999999999999e-06 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588820+0000", 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4759999999999998e-06 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588910+0000", 2024-09-17T23:03:09.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0679000000000004e-05 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.589027+0000", 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000116517 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:09.832 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:09.834 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:09.834 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:09.832+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:09.933 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:09.931+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:09.976 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:09.976 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:09.976 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:09.976 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:09.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:10.035 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:10.032+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:10.127 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:10.127 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:10.127 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:10.128 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:10.128 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:10.137 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:10.137 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:10.133+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:10.236 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:10.234+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:10.278 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:10.278 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:10.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:10.279 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:10.279 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:10.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:03:10.327 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:03:10.372 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:10.370+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:10.390 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:10.390 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:10.390 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:10.390 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:10.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:03:10.442 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:10.440+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:10.503 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:10.503 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:10.503 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:10.503 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:10.503 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:10.511 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:03:10.552 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:10.550+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:10.640 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:10.638+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:10.657 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.442332397999998, 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.188649542, 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.658 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212076+0000", 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212078+0000", 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.669e-06 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212092+0000", 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4959e-05 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212105+0000", 2024-09-17T23:03:10.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2283000000000001e-05 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212114+0000", 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8990000000000007e-06 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212177+0000", 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3533000000000003e-05 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:10.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.212187+0000", 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4790000000000002e-06 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399184+0000", 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.18699711599999999 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399382+0000", 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019809299999999999 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.399604+0000", 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00022205 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400259+0000", 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065476499999999997 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400634+0000", 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00037537600000000002 2024-09-17T23:03:10.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400675+0000", 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1291999999999997e-05 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.400725+0000", 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0028000000000003e-05 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:21 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [write 65536~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.234112107000001, 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076785070000000002, 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 21 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.665 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420296+0000", 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420297+0000", 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.54e-07 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420377+0000", 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9809999999999997e-05 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420387+0000", 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0026e-05 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420391+0000", 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5510000000000001e-06 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420833+0000", 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044210300000000001 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420887+0000", 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3324e-05 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420973+0000", 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6428999999999995e-05 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422150+0000", 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011773039999999999 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427781+0000", 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056303120000000002 2024-09-17T23:03:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427900+0000", 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000118769 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427975+0000", 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5124999999999996e-05 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.670 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:22 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.234003264999998, 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0077273339999999998, 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 22 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420405+0000", 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420406+0000", 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4000000000000001e-07 2024-09-17T23:03:10.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420410+0000", 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5789999999999997e-06 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420417+0000", 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8900000000000001e-06 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.420423+0000", 2024-09-17T23:03:10.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7679999999999997e-06 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421317+0000", 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00089395000000000002 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421370+0000", 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3492999999999998e-05 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.421455+0000", 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4351000000000006e-05 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.422372+0000", 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091742899999999999 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.427997+0000", 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056245289999999996 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428104+0000", 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106944 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.428132+0000", 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8761000000000001e-05 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.676 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.036384230000003, 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063598999999999999, 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 110 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618024+0000", 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618025+0000", 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8400000000000004e-07 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618029+0000", 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1489999999999996e-06 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618037+0000", 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0979999999999994e-06 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618047+0000", 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0247e-05 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622380+0000", 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043329900000000001 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622456+0000", 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6040999999999999e-05 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.622592+0000", 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013632600000000001 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624289+0000", 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696737 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624301+0000", 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2099000000000001e-05 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624346+0000", 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4634e-05 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624384+0000", 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7994999999999998e-05 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.036334459000003, 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0064380779999999999, 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.682 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 111 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:03:10.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618074+0000", 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9699999999999996e-07 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618078+0000", 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.811e-06 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618092+0000", 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.413e-05 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618103+0000", 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0232e-05 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623161+0000", 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050586880000000004 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623220+0000", 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8449000000000002e-05 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623293+0000", 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3139000000000006e-05 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624390+0000", 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00109734 2024-09-17T23:03:10.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624455+0000", 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4478000000000002e-05 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624489+0000", 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3853000000000003e-05 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624512+0000", 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3360999999999999e-05 2024-09-17T23:03:10.687 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.036288382999999, 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0074594789999999998, 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.688 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 112 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618120+0000", 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618121+0000", 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7000000000000004e-07 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618204+0000", 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3512999999999998e-05 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618213+0000", 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2359999999999993e-06 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618219+0000", 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1770000000000003e-06 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623528+0000", 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053089269999999997 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623604+0000", 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5462000000000004e-05 2024-09-17T23:03:10.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.623734+0000", 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013053399999999999 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625477+0000", 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001742653 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625492+0000", 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4825e-05 2024-09-17T23:03:10.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625539+0000", 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7033999999999997e-05 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625579+0000", 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0448000000000003e-05 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.036176341000001, 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0082098180000000007, 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 113 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618232+0000", 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618233+0000", 2024-09-17T23:03:10.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1200000000000003e-07 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618240+0000", 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2989999999999999e-06 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618247+0000", 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.542e-06 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618252+0000", 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8010000000000003e-06 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624556+0000", 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0063039050000000003 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624641+0000", 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4456999999999995e-05 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.624763+0000", 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000122917 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625627+0000", 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086396699999999999 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626341+0000", 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00071333799999999999 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626391+0000", 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0192999999999999e-05 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626442+0000", 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0787e-05 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.699 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.036148308000001, 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0087386709999999999, 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 114 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.700 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618260+0000", 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3799999999999998e-07 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618263+0000", 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8820000000000001e-06 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618267+0000", 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0840000000000002e-06 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618271+0000", 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8449999999999996e-06 2024-09-17T23:03:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625074+0000", 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068027599999999997 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625121+0000", 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6805999999999999e-05 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625206+0000", 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5538999999999995e-05 2024-09-17T23:03:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626903+0000", 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001696454 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626916+0000", 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3634e-05 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626962+0000", 2024-09-17T23:03:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5357e-05 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626999+0000", 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6971999999999998e-05 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:03:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.036129311000003, 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093097030000000008, 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 115 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:03:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618279+0000", 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.27e-07 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618326+0000", 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6261999999999999e-05 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618331+0000", 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0889999999999999e-06 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618334+0000", 2024-09-17T23:03:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.23e-06 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625664+0000", 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0073300989999999996 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625739+0000", 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5535000000000001e-05 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.625882+0000", 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014275299999999999 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627033+0000", 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001151116 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627506+0000", 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047273299999999997 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627550+0000", 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4189e-05 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627589+0000", 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.837e-05 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.036065731000001, 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0093607020000000003, 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 116 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618343+0000", 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9299999999999998e-07 2024-09-17T23:03:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618347+0000", 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.664e-06 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618351+0000", 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3359999999999997e-06 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618354+0000", 2024-09-17T23:03:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8540000000000001e-06 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626489+0000", 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0081350580000000006 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626538+0000", 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9490999999999998e-05 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.626617+0000", 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8404000000000004e-05 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627611+0000", 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00099458599999999999 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627624+0000", 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2598e-05 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627668+0000", 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3501000000000002e-05 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627703+0000", 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5716999999999997e-05 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.036049462999998, 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.009520489, 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 117 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618359+0000", 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2399999999999999e-07 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618361+0000", 2024-09-17T23:03:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1059999999999998e-06 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618365+0000", 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6150000000000001e-06 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.618367+0000", 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6790000000000001e-06 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627063+0000", 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0086957619999999992 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627146+0000", 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2879000000000004e-05 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627287+0000", 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014122700000000001 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627757+0000", 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000470066 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627820+0000", 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.279e-05 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627856+0000", 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5463999999999998e-05 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:21.627879+0000", 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3677e-05 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.630992007000003, 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0075600570000000002, 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 137 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023416+0000", 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023417+0000", 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8599999999999998e-07 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023466+0000", 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8794000000000001e-05 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023474+0000", 2024-09-17T23:03:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7139999999999999e-06 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023480+0000", 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8019999999999997e-06 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027360+0000", 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038796270000000001 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027440+0000", 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0753000000000004e-05 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.027519+0000", 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8203999999999999e-05 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028755+0000", 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012362790000000001 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030928+0000", 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021728120000000001 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030954+0000", 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5910000000000001e-05 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030976+0000", 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2676000000000001e-05 2024-09-17T23:03:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.630910919999998, 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076214569999999999, 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 138 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023497+0000", 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023498+0000", 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8800000000000002e-07 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023503+0000", 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3669999999999996e-06 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023510+0000", 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7889999999999997e-06 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023519+0000", 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.098e-06 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028869+0000", 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053500609999999997 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.028946+0000", 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6508999999999995e-05 2024-09-17T23:03:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029084+0000", 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013776700000000001 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030981+0000", 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001897971 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031025+0000", 2024-09-17T23:03:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3883e-05 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031079+0000", 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3325999999999997e-05 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031119+0000", 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0098000000000001e-05 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.630879907999997, 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076808450000000004, 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 139 2024-09-17T23:03:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023528+0000", 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023529+0000", 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023532+0000", 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.456e-06 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023539+0000", 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6540000000000002e-06 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023544+0000", 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1529999999999996e-06 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029398+0000", 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0058541829999999998 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029444+0000", 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5605999999999997e-05 2024-09-17T23:03:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029521+0000", 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6689999999999999e-05 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031156+0000", 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0016352700000000001 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031163+0000", 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9269999999999999e-06 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031187+0000", 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4235000000000001e-05 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031209+0000", 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.213e-05 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.630852746999999, 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0078442649999999996, 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 140 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023556+0000", 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0200000000000002e-07 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023622+0000", 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6181999999999998e-05 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023631+0000", 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5750000000000001e-06 2024-09-17T23:03:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023638+0000", 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4630000000000004e-06 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029770+0000", 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0061317089999999999 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029845+0000", 2024-09-17T23:03:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5439999999999996e-05 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.029968+0000", 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012251800000000001 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031244+0000", 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012764359999999999 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031339+0000", 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4217999999999998e-05 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031380+0000", 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1258999999999999e-05 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031400+0000", 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9962999999999998e-05 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.630756163000001, 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0085476930000000003, 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 141 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023652+0000", 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023653+0000", 2024-09-17T23:03:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6499999999999999e-07 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023657+0000", 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0400000000000003e-06 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023664+0000", 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1790000000000002e-06 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.023669+0000", 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3029999999999999e-06 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030600+0000", 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069304589999999999 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030647+0000", 2024-09-17T23:03:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7354000000000001e-05 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.030718+0000", 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1116000000000001e-05 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.031458+0000", 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00074007599999999999 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032158+0000", 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069986799999999997 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032181+0000", 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.2832000000000001e-05 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.032200+0000", 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8800999999999998e-05 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.122046593999997, 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068810570000000003, 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 156 2024-09-17T23:03:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532362+0000", 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8999999999999997e-07 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532365+0000", 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0079999999999998e-06 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532371+0000", 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1369999999999999e-06 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532378+0000", 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.443e-06 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533797+0000", 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0014196530000000001 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533838+0000", 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0629e-05 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.533916+0000", 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8107000000000003e-05 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535288+0000", 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001372123 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539185+0000", 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038971600000000002 2024-09-17T23:03:10.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539219+0000", 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3905000000000001e-05 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539243+0000", 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3402000000000001e-05 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.122022858999998, 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0069027610000000003, 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 157 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532385+0000", 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532386+0000", 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5999999999999999e-07 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532393+0000", 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8929999999999999e-06 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532398+0000", 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6869999999999999e-06 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532407+0000", 2024-09-17T23:03:10.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8270000000000004e-06 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534365+0000", 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0019577510000000002 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534418+0000", 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2936000000000003e-05 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534482+0000", 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4212000000000001e-05 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535659+0000", 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011769230000000001 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539247+0000", 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0035881020000000001 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539269+0000", 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1807e-05 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539288+0000", 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9162999999999999e-05 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.764 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.121989618999997, 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.006929943, 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 158 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532419+0000", 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5300000000000004e-07 2024-09-17T23:03:10.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532590+0000", 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017035600000000001 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532598+0000", 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4009999999999997e-06 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532604+0000", 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9209999999999997e-06 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534755+0000", 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021515750000000002 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534795+0000", 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9229e-05 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.534866+0000", 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1607999999999996e-05 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535934+0000", 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001068049 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539293+0000", 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033591300000000001 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539328+0000", 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4715999999999998e-05 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539349+0000", 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0404999999999999e-05 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.770 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4195.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.121793699000001, 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0067798900000000002, 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4195", 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2491191468", 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 159 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532615+0000", 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1999999999999999e-07 2024-09-17T23:03:10.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532619+0000", 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6859999999999999e-06 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532626+0000", 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3810000000000001e-06 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:10.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.532632+0000", 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7049999999999996e-06 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535305+0000", 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0026735190000000001 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535345+0000", 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9313000000000001e-05 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 0", 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.535408+0000", 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3072999999999997e-05 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.536170+0000", 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076224300000000001 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539352+0000", 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0031817310000000001 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539376+0000", 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3743e-05 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:22.539394+0000", 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8876e-05 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:10.776 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:10.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:10.778 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:10.775+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:10.879 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:10.876+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:10.948 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:10.949 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:10.949 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:10.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:11.004 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:11.002+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:11.072 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:11.072 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:11.072 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:11.072 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:11.072 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:11.081 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:11.078+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:11.081 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:11.182 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:11.179+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:11.283 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:11.281+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:11.285 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:11.285 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.860580917, 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:11.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.860134004999999, 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.290 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:11.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.294 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.843455364, 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:11.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:11.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.297 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:11.299 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.842901693999998, 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:11.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.842290069999997, 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:11.304 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:11.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.841637370999997, 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.309 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:11.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.841101231000003, 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:11.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:11.318 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.826298033999997, 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:11.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:11.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.825955350999998, 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.323 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.324 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.825385965999999, 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:11.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:11.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.822905783000003, 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:11.332 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:11.336 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.815402317, 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.337 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:11.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:11.341 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.814900872000003, 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:11.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.812265150999998, 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.346 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.347 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:11.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.804407480000002, 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:11.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:11.355 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.666301656000002, 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.357 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:11.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:11.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.256999256, 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.360 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.361 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.362 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.255484869999997, 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:11.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:11.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 48.751651377000002, 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.369 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.370 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:11.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:11.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.373 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 48.746250257, 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:11.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:11.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:11.377 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:11.378 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:11.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:11.380 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:03:11.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:11.421 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:11.418+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:11.484 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:11.483+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:11.538 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:11.538 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:11.538 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:11.548 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:11.585 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:11.582+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:11.616 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:11.617 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:11.652 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:11.652 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:11.674 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:11.674 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:11.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:11.684 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:11.685 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:11.687 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:11.684+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:11.715 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:11.716 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:11.746 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:11.746 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:11.777 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:11.777 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:11.787 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:11.784+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:11.808 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:03:11.809 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:03:11.813 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:11.813 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:11.841 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:11.841 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:11.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:11.887 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:11.886+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:11.988 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:11.986+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:12.004 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:12.005 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:12.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:12.089 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:12.087+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:12.120 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:12.120 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:12.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:12.190 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:12.188+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:12.279 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:12.279 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:12.288 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:12.291 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:12.289+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:12.392 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:12.389+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:12.405 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:12.405 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:12.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:12.493 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:12.491+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:12.559 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:12.559 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:12.568 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:12.612 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:12.610+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:12.672 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:12.672 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:12.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:12.694 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:12.692+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:12.795 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:03:12.793+0000 7f9dd4f56640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 33762) UID: 0 2024-09-17T23:03:12.825 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:12.826 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:12.834 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:12.918 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:12.916+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:12.978 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:12.987 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:13.028 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:13.026+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:13.097 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:13.094+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:13.131 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:13.131 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:13.139 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:13.223 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:13.221+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:13.283 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:13.283 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:13.292 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:13.325 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1] live_osds: [0, 2, 3, 4, 5, 6, 7] 2024-09-17T23:03:13.325 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:03:13.325 INFO:tasks.thrashosds.thrasher:Killing osd 7, live_osds are [0, 2, 3, 4, 5, 6, 7] 2024-09-17T23:03:13.325 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T23:03:13.325 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:03:13.333 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:13.331+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:13.367 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T23:03:13.367 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.7 2024-09-17T23:03:13.368 INFO:tasks.thrashosds.thrasher:remote for osd 7 is ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:03:13.368 INFO:tasks.thrashosds.thrasher:remote for exp osd 1 is ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:03:13.368 DEBUG:teuthology.orchestra.run.smithi005:> type ceph-objectstore-tool 2024-09-17T23:03:13.382 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:03:13.383 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T23:03:13.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op list-pgs 2024-09-17T23:03:13.425 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:13.423+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:13.438 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:13.438 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:13.446 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:13.500 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:13.497+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:13.549 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:13.549 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:13.558 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:13.603 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:13.601+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:13.701 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:13.698+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:13.728 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:13.728 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:13.741 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:13.802 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:13.800+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:13.814 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:13.903 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:13.901+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:13.932 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:13.932 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:13.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:14.004 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:14.001+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:14.009 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:14.009 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:14.028 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:14.028 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:14.054 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:14.054 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.650266420000001, 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.075 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:14.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:14.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.079 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.649819508, 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:14.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:14.084 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.633140867000002, 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:14.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:14.089 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.632587196999999, 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:14.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.092 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:14.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:14.094 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.631975572999998, 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:14.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.631322873999999, 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.099 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:14.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.630786733999997, 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:14.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.108 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.615983536999998, 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:14.113 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.615640853999999, 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:14.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:14.118 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.615071469, 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.612591285999997, 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.123 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:14.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.605087820000001, 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.128 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:14.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.132 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.604586374999997, 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:14.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.601950653999999, 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.138 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.594092983000003, 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:14.147 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.455987159000003, 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:14.152 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.046684759000001, 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:14.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 52.045170372999998, 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:14.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:14.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 51.541336880000003, 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:14.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 51.535935760000001, 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:14.166 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:14.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:14.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.170 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.171 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:14.171 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:14.172 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:14.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:14.173 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:14.174 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:14.174 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:14.175 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:14.169+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:14.272 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:14.270+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:14.286 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:14.287 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:14.287 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:14.287 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:14.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:03:14.333 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:14.339 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:14.340 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:14.373 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:14.371+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:14.452 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:14.452 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:14.453 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:14.453 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:14.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:14.474 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:14.471+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 48.330530111999998, 2024-09-17T23:03:14.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:03:14.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.575 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 4.9789084580000003, 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00018986200000000001, 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 2 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:14.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590637+0000", 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3290000000000001e-06 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:14.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590646+0000", 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6519999999999995e-06 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590660+0000", 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3485e-05 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590672+0000", 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2531000000000001e-05 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590734+0000", 2024-09-17T23:03:14.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1989999999999994e-05 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590825+0000", 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.0875e-05 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:14.579 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:14.581 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:14.581 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:14.578+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:14.681 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:14.680+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:14.690 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:14.690 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:14.690 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:14.699 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:14.782 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:14.780+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:14.808 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:14.808 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:14.808 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:14.808 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:14.808 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:14.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:14.882 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:14.880+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:14.965 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:14.965 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:14.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:14.965 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:14.965 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:14.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:15.018 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:15.016+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:15.085 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:15.082+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:15.089 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:15.089 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:15.089 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:15.089 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:15.098 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:15.185 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:15.183+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:15.243 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:15.243 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:15.243 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:15.244 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:15.244 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:15.252 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:15.296 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:15.294+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:15.357 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:15.358 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:15.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:15.358 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:15.358 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:15.360 INFO:teuthology.orchestra.run.smithi005.stdout:2.6 2024-09-17T23:03:15.360 INFO:teuthology.orchestra.run.smithi005.stdout:2.4 2024-09-17T23:03:15.361 INFO:teuthology.orchestra.run.smithi005.stdout:2.2 2024-09-17T23:03:15.361 INFO:teuthology.orchestra.run.smithi005.stdout:2.0 2024-09-17T23:03:15.366 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:15.387 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:15.384+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:15.488 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:15.485+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:15.510 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:15.510 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:15.510 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:15.510 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:15.519 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:15.589 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:15.586+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:15.662 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:15.663 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:15.663 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:15.663 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:15.663 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:15.671 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:15.718 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:15.716+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:15.774 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.535614172000002, 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.531872888999999, 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:03:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:03:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.527010273000002, 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:03:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:03:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.526578284000003, 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:03:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.534112209, 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.530966423999999, 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:03:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 47.528237283999999, 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 47.524814458000002, 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:03:15.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:03:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4201.0:1 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.1832672459999998, 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00023331, 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4201", 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588795+0000", 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.722e-06 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588801+0000", 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2779999999999999e-06 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588811+0000", 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6379999999999999e-06 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588820+0000", 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4759999999999998e-06 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588910+0000", 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0679000000000004e-05 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.589027+0000", 2024-09-17T23:03:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000116517 2024-09-17T23:03:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:15.822 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:15.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:15.824 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:15.822+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:15.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op export --pgid 2.0 --file /var/log/ceph/exp.2.0.1 2024-09-17T23:03:15.963 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:15.961+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:15.966 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:15.966 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:15.966 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:15.966 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:15.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:16.025 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:16.023+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:16.077 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:16.077 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:16.077 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:16.077 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:16.077 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:16.086 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:16.129 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:16.127+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:16.189 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:16.189 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:16.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:16.189 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:16.190 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:16.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:16.240 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:16.238+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:16.324 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:16.324 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:16.324 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:16.326 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:16.325+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:16.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:16.340 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:16.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:03:16.430 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:16.428+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:16.489 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:16.489 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:16.489 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:16.503 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:16.545 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:16.543+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:16.563 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:16.563 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:16.594 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:16.595 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:16.627 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:16.627 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:16.629 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:16.627+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:16.658 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:16.658 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:16.665 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:16.666 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:16.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:16.688 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:16.689 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:16.711 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:16.711 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:16.712 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:16.715 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:16.715 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:16.730 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:16.727+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:16.830 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:16.829+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:16.834 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:16.834 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:16.850 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:16.931 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:16.928+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:16.960 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:16.961 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:16.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:17.054 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:17.052+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:17.121 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:17.121 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:17.131 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:17.133 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:17.130+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:17.233 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:17.231+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:17.283 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:17.283 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:17.292 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:17.336 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:17.334+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:17.341 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:03:17.407 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:17.408 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:17.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:17.460 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:17.458+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:17.526 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:17.526 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:17.535 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:17.577 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:17.575+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:17.638 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:17.635+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:17.647 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:17.647 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:17.656 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:17.740 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:17.738+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:17.800 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:17.801 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:17.809 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:17.837 INFO:teuthology.orchestra.run.smithi005.stderr:Exporting 2.0 info 2.0( empty local-lis/les=18/19 n=0 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-17T23:03:17.838 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:17.836+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:17.841 INFO:teuthology.orchestra.run.smithi005.stderr:Export successful 2024-09-17T23:03:17.939 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:17.937+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:17.952 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:17.952 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:17.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:18.040 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:18.038+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:18.106 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:18.106 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:18.115 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:18.158 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:18.156+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:18.218 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:18.218 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:18.226 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:18.242 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:18.240+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:18.343 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:18.341+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:18.357 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --force --op remove --pgid 2.0 2024-09-17T23:03:18.372 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:18.372 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:18.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:18.465 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:18.463+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:18.525 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:18.526 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:18.535 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:18.545 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:18.543+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:18.646 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:18.643+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:18.677 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:18.677 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:18.685 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:18.716 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:18.769 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:18.767+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:18.828 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:18.828 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:18.837 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:18.878 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:18.876+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:18.916 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:18.917 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:18.948 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:18.946+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:18.952 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:18.952 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:18.985 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:18.985 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:18.999 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:18.999 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:19.000 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:19.013 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:19.016 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:19.016 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:19.041 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:19.041 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:19.048 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:19.046+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:19.061 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:19.061 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:19.061 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:19.066 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:19.066 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:19.150 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:19.148+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:19.180 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:19.181 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:19.181 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:19.191 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:19.251 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:19.248+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.902971067999999, 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:19.328 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:19.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:19.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.902524155999998, 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:19.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:19.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.885845515, 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.337 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.338 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:19.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.341 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.885291844999998, 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:19.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:19.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:19.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:19.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:19.348 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.884680220999996, 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:19.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:19.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.353 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.884027521999997, 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:19.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.883491382000003, 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:19.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:19.362 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.868688185000003, 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:19.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:19.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.868345501999997, 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.367 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:19.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.369 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.370 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.867776116999998, 2024-09-17T23:03:19.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:19.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.865295934000002, 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:19.376 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.378 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.379 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.857792468, 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:19.380 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.384 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.857291023000002, 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.385 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:19.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:19.387 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.388 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.854655301999998, 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.389 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:19.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:19.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:19.393 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.846797631000001, 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:19.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.396 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.397 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.708691807000001, 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.398 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:19.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:19.401 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.299389407, 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.403 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.404 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.406 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 57.297875021000003, 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.407 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:19.409 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:19.410 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 56.794041528000001, 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.411 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:19.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 56.788640407999999, 2024-09-17T23:03:19.415 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:19.419 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:19.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:03:19.421 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:19.418+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:19.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:19.521 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:19.518+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:19.621 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:19.618+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:19.630 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:19.630 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:19.630 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:19.630 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:19.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:19.721 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:19.719+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:19.823 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:19.821+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:19.853 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:19.853 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:19.853 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:19.854 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:19.854 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:19.862 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:19.946 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:19.944+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:20.024 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:20.022+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 53.832311994999998, 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:03:20.073 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:03:20.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:03:20.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:20.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 10.480690341000001, 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00018986200000000001, 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 2 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:20.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590637+0000", 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3290000000000001e-06 2024-09-17T23:03:20.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590646+0000", 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6519999999999995e-06 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590660+0000", 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3485e-05 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590672+0000", 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2531000000000001e-05 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590734+0000", 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1989999999999994e-05 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590825+0000", 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.0875e-05 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:20.081 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:20.082 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:20.082 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:20.085 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:20.125 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:20.122+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:20.226 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:20.223+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:20.258 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:20.258 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:20.258 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:20.268 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:20.323 INFO:teuthology.orchestra.run.smithi005.stdout: marking collection for removal 2024-09-17T23:03:20.323 INFO:teuthology.orchestra.run.smithi005.stdout:setting '_remove' omap key 2024-09-17T23:03:20.324 INFO:teuthology.orchestra.run.smithi005.stdout:finish_remove_pgs 2.0_head removing 2.0 2024-09-17T23:03:20.327 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:20.324+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:20.327 INFO:teuthology.orchestra.run.smithi005.stdout:Remove successful 2024-09-17T23:03:20.354 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:03:20.411 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:20.411 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:20.412 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:20.412 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:20.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:20.427 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:20.424+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:20.528 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:20.525+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:20.532 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:20.533 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:20.533 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:20.542 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:20.629 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:20.627+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:20.657 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:20.658 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:20.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:20.730 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:20.727+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:20.770 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:20.771 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:20.771 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:20.771 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:20.771 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:20.779 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:20.831 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:20.829+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:20.844 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-7 --journal-path /var/lib/ceph/osd/ceph-7/journal --op list-pgs 2024-09-17T23:03:20.885 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:20.885 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:20.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:20.885 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:20.885 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:20.894 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:20.935 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:20.932+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:21.032 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:21.029+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:21.037 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:21.038 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:21.038 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:21.038 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:21.046 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:21.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:21.132 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:21.129+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:21.189 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:21.190 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:21.190 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:21.190 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:21.190 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:21.198 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:21.239 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:21.236+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:21.261 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:21.261 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:21.262 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:21.293 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:21.294 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:21.325 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:21.325 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:21.334 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:21.332+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 55.104132772, 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.343 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:21.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:21.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:21.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:21.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 55.100391489000003, 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.350 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:03:21.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 55.095528872999999, 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.354 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:03:21.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:21.358 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 55.095096884, 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.362 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.102630808999997, 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:21.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:21.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:21.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.099485024000003, 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.369 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:03:21.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.373 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.096755883999997, 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:21.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.093333057999999, 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.380 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4201.0:1 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 11.751785846000001, 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00023331, 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:21.384 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4201", 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.385 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588795+0000", 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.722e-06 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:21.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588801+0000", 2024-09-17T23:03:21.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2779999999999999e-06 2024-09-17T23:03:21.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.388 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:21.388 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588811+0000", 2024-09-17T23:03:21.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6379999999999999e-06 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588820+0000", 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4759999999999998e-06 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588910+0000", 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0679000000000004e-05 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:21.389 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.589027+0000", 2024-09-17T23:03:21.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000116517 2024-09-17T23:03:21.390 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.390 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.390 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.390 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:21.390 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:21.390 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:21.390 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:21.391 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:21.391 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:21.392 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:21.392 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:21.403 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:21.404 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:21.404 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:21.408 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:21.408 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:21.436 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:21.433+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:21.498 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:21.498 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:21.507 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:21.536 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:21.534+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:21.637 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:21.634+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:21.650 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:21.650 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:21.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:21.737 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:21.735+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:21.767 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:21.768 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:21.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:21.839 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:21.836+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:21.888 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:21.888 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:21.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:21.942 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:21.940+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:22.040 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:22.038+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:22.046 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:22.046 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:22.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:22.142 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:22.138+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:22.237 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:22.237 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:22.243 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:22.240+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:22.250 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:22.344 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:22.341+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:22.360 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:22.361 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:22.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:03:22.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:22.457 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:22.455+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:22.545 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:22.543+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:22.583 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:22.583 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:22.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:22.646 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:22.642+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:22.746 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:22.744+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:22.776 INFO:teuthology.orchestra.run.smithi152.stdout:2.7 2024-09-17T23:03:22.776 INFO:teuthology.orchestra.run.smithi152.stdout:2.0 2024-09-17T23:03:22.776 INFO:teuthology.orchestra.run.smithi152.stdout:1.0 2024-09-17T23:03:22.804 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:22.804 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:22.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:22.858 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:22.856+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:22.948 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:22.946+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:22.967 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:22.967 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:22.977 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:23.049 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:23.046+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:23.086 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:23.086 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:23.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:23.150 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:23.148+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:23.204 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:23.204 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:23.213 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:23.257 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:23.254+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:23.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.0.1 2024-09-17T23:03:23.321 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:23.321 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:23.330 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:23.351 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:03:23.352 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:23.349+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:23.409 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:23.453 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:23.449+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:23.474 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:23.474 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:23.483 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:23.567 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:23.564+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:23.579 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:23.579 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:23.598 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:23.598 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:23.628 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:23.628 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:23.628 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:23.629 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:23.637 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:23.654 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:23.652+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:23.658 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:23.659 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:23.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:23.689 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:23.705 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:23.706 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:23.706 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:23.711 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:23.711 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:23.755 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:23.753+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:23.780 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:23.780 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:23.780 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:23.780 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:23.789 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:23.857 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:23.853+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:23.893 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:23.893 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:23.893 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:23.893 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:23.893 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:23.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:23.985 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:23.982+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:24.045 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:24.045 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:24.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:24.045 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:24.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.045 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:24.045 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.806583773, 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:24.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:24.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:24.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.802842490000003, 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:24.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:03:24.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:03:24.056 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.797979873999999, 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:24.057 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.797547885, 2024-09-17T23:03:24.061 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:03:24.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:24.065 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 56.805081809999997, 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:24.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:24.071 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 56.801936025000003, 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:03:24.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 55.799206884999997, 2024-09-17T23:03:24.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:24.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:24.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:24.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 55.795784058999999, 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.083 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:03:24.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4201.0:1 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.454236847000001, 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00023331, 2024-09-17T23:03:24.087 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4201", 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588795+0000", 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.722e-06 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588801+0000", 2024-09-17T23:03:24.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2779999999999999e-06 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588811+0000", 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6379999999999999e-06 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588820+0000", 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4759999999999998e-06 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:24.090 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588910+0000", 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0679000000000004e-05 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.589027+0000", 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000116517 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:24.091 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:24.093 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:24.093 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:24.090+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:24.193 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:24.191+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:24.236 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:24.237 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:24.237 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:24.237 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:24.245 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:24.294 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:24.292+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:24.348 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:24.349 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:24.357 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:24.400 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:24.397+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:24.459 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:24.460 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:24.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:24.460 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:24.460 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:24.468 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:24.512 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:24.510+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:24.580 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:24.580 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:24.580 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:24.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:24.630 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:24.628+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:24.696 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:24.694+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:24.737 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:24.737 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:24.737 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:24.737 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:24.737 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:24.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:24.797 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:24.794+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:24.857 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:24.857 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:24.857 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:24.857 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:24.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.857 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:24.857 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:24.857 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.432358591000003, 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.858 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:24.862 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.431911679000002, 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.866 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.415233037999997, 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:24.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:24.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.414679368000002, 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:24.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:24.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.875 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.414067744, 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:24.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:24.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.413415045000001, 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.880 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.412878904999999, 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:24.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:24.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.398075708, 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:24.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.397733025000001, 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:24.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:24.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:24.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.397163640000002, 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:24.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:24.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.394683456999999, 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:24.903 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:24.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:24.907 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.387179990999996, 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:24.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:24.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.386678545999999, 2024-09-17T23:03:24.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:24.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:24.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.384042825000002, 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.917 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:24.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.921 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.376185153999998, 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.925 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.238079329999998, 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:24.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 62.828776929999997, 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.930 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:24.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:24.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.933 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 62.827262544, 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.935 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:24.939 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 62.323429050999998, 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:24.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.944 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 62.318027931000003, 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:24.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:24.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:24.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:24.949 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:24.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:24.951 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:24.947+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:25.051 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:25.049+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:25.064 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:25.064 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:25.064 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:25.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:25.160 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:25.158+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:25.220 INFO:teuthology.orchestra.run.smithi005.stdout:get_pg_num_history pg_num_history pg_num_history(e21 pg_nums {1={15=1},2={18=8}} deleted_pools ) 2024-09-17T23:03:25.220 INFO:teuthology.orchestra.run.smithi005.stdout:Importing pgid 2.0 2024-09-17T23:03:25.220 INFO:teuthology.orchestra.run.smithi005.stdout:write_pg epoch 21 info 2.0( empty local-lis/les=18/19 n=0 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-17T23:03:25.224 INFO:teuthology.orchestra.run.smithi005.stdout:Import successful 2024-09-17T23:03:25.238 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:25.239 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:25.239 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:25.239 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:25.239 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:25.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:25.290 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:25.288+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:25.354 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:25.351+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:25.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:03:25.426 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:25.426 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 59.185773597999997, 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.427 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:03:25.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:25.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:03:25.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.431 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 15.834151944, 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00018986200000000001, 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 2 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:25.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590637+0000", 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3290000000000001e-06 2024-09-17T23:03:25.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590646+0000", 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6519999999999995e-06 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590660+0000", 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3485e-05 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590672+0000", 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2531000000000001e-05 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590734+0000", 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1989999999999994e-05 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590825+0000", 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.0875e-05 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:25.435 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:25.436 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:25.436 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:25.436 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:25.436 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:25.439 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:25.455 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:25.452+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:25.555 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:25.553+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:25.608 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:25.609 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:25.609 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:25.609 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:25.621 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:25.663 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:25.661+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:25.712 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:25.746 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /var/log/ceph/exp.2.0.1 2024-09-17T23:03:25.785 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:25.785 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:25.785 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:25.786 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:25.783+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:25.799 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:25.859 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:25.856+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:25.910 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:25.910 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:25.911 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:25.943 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:25.944 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:25.959 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:25.957+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:25.976 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:25.976 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:26.008 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:26.008 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:26.020 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:26.020 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:26.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:26.039 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:26.039 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:26.061 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:26.058+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:26.072 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:26.072 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:26.072 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:26.077 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:26.077 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:26.149 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:26.149 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:26.158 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:26.161 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:26.159+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:26.262 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:26.262 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:26.262 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:26.259+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:26.270 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:26.363 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:26.359+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:26.370 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:03:26.417 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:26.417 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:26.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:26.463 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:26.461+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:26.565 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:26.563+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:26.569 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:26.569 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:26.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:26.666 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:26.663+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:26.681 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:26.681 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:26.690 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:26.767 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:26.764+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:26.794 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:26.795 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:26.803 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:26.887 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:26.884+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:26.949 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:26.949 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:26.957 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:26.998 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:26.995+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:27.070 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:27.068+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:27.101 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:27.101 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:27.110 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:27.171 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:27.168+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:27.213 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:27.213 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:27.222 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:27.272 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:27.269+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:27.340 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:27.574 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:27.576 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:27.576 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:27.573+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:27.676 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:27.674+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:27.730 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:27.730 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:27.739 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:27.783 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:27.781+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:27.847 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:27.847 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:27.857 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:27.878 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:27.876+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:27.980 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:27.977+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:28.007 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:28.008 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:28.017 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:28.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:28.081 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:28.079+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:28.154 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:28.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:28.211 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:28.209+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:28.237 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:28.237 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:28.238 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:28.271 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:28.272 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:28.282 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:28.279+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:28.303 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:28.304 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 62.074409248999999, 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 18.722787595, 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00018986200000000001, 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 2 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590637+0000", 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3290000000000001e-06 2024-09-17T23:03:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590646+0000", 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6519999999999995e-06 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590660+0000", 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3485e-05 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590672+0000", 2024-09-17T23:03:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2531000000000001e-05 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590734+0000", 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1989999999999994e-05 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590825+0000", 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.0875e-05 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:28.324 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:28.324 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:28.324 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:28.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:28.339 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:28.339 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:28.357 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:28.357 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:28.361 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:28.361 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:28.383 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:03:28.402 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:28.400+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:28.452 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:28.452 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:28.452 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:28.452 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:28.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:28.483 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:28.480+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:28.576 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:28.577 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:28.577 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:28.577 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:28.577 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:28.584 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:28.581+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:28.586 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:28.686 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:28.683+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:28.696 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:28.697 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:28.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:28.697 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:28.697 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:28.706 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:28.786 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:28.784+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:28.821 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:28.821 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:28.821 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:28.821 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:28.830 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:28.887 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:28.884+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:28.934 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:28.934 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:28.934 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:28.934 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:28.934 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:28.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:29.027 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:29.024+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:29.086 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:29.087 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:29.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:29.087 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:29.087 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:29.089 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:29.086+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:29.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:29.190 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:29.186+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:29.240 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:29.240 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:29.240 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:29.240 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:29.249 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:29.291 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:29.288+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:29.379 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:03:29.391 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:29.388+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:29.394 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:29.394 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:29.394 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:29.394 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:29.394 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:29.403 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:29.492 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:29.488+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:29.547 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:29.547 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 63.308837529000002, 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:29.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:29.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:29.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 63.305096245999998, 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.558 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 63.300233630000001, 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:29.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:03:29.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:03:29.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 63.299801641000002, 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:29.563 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.566 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.307335565999999, 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:29.567 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:29.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:29.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.573 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.304189780999998, 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:03:29.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:03:29.577 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 61.301460640999998, 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:29.578 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:29.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:29.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 61.298037815000001, 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:29.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:03:29.588 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4201.0:1 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.956490602999999, 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00023331, 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4201", 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:29.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588795+0000", 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.722e-06 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588801+0000", 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2779999999999999e-06 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588811+0000", 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6379999999999999e-06 2024-09-17T23:03:29.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588820+0000", 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4759999999999998e-06 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588910+0000", 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0679000000000004e-05 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.589027+0000", 2024-09-17T23:03:29.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000116517 2024-09-17T23:03:29.593 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.593 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.593 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.593 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:29.593 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:29.593 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:29.594 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:29.595 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:29.591+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:29.695 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:29.692+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:29.737 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:29.737 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:29.737 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:29.737 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:29.745 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:29.796 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:29.793+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:29.848 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:29.848 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:29.849 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:29.849 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:29.849 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:29.857 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:29.901 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:29.898+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:29.960 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:29.961 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:29.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:29.961 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:29.961 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:29.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:30.011 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:30.009+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:30.099 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:30.096+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:30.138 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:30.138 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:30.138 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:30.139 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:30.150 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:30.199 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:30.196+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:30.262 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:30.262 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:30.263 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:30.263 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:30.263 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:30.273 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:30.300 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:30.298+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:30.362 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:30.409 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:30.406+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:30.485 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.061073312000005, 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.486 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:30.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:30.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.060626400000004, 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:30.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.043947759000005, 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:30.495 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:30.497 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.499 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.043394089000003, 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.500 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:30.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.503 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:30.504 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.042782465000002, 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.505 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.506 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:30.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:30.508 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.042129766000002, 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.509 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.510 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.511 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:30.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.041593625999994, 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:30.515 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:30.517 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:30.518 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.026790429000002, 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.519 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:30.521 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.522 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.026447746000002, 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.523 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.524 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:30.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.526 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.527 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.025878360999997, 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:30.528 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.023398177999994, 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:30.532 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:30.533 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:30.534 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:30.535 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:30.536 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.015894712000005, 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.537 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:30.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.015393266999993, 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.543 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.544 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:30.545 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.012757546000003, 2024-09-17T23:03:30.546 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:30.547 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.548 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:30.550 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 69.004899875000007, 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.551 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:30.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 68.866794050999999, 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:30.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 68.457491650999998, 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:30.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:30.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.563 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.564 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 68.455977265000001, 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.565 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:30.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.568 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:30.569 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 67.952143771999999, 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.570 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:30.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.573 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 67.946742651999998, 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:30.574 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:30.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.579 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:30.579 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:30.579 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:30.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:30.581 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:30.581 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:30.582 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:30.582 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:30.582 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:30.576+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:30.591 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:30.591 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:30.622 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:30.622 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:30.652 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:30.653 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:30.681 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:30.678+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:30.684 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:30.684 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:30.689 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:30.690 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:30.703 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:30.703 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:30.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:30.782 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:30.779+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:30.817 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7] live_osds: [0, 2, 3, 4, 5, 6] 2024-09-17T23:03:30.817 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:03:30.817 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-17T23:03:30.817 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T23:03:30.817 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T23:03:30.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-17T23:03:30.883 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:30.880+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:30.923 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:30.923 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:30.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:30.966 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:30.966 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T23:03:30.967 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:31.018 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:31.015+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:31.078 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:31.079 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:31.085 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:31.082+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:31.088 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:31.186 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:31.183+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:31.287 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:31.284+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:31.298 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:31.298 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:31.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:31.387 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:31.384+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:31.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:03:31.423 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:31.423 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:31.433 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:31.517 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:31.514+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:31.588 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:31.585+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:31.643 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:31.644 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:31.656 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:31.700 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:31.698+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:31.771 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:31.771 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:31.781 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:31.822 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:31.820+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:31.890 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:31.887+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:31.925 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:31.925 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:31.934 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:31.991 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:31.988+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:32.077 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:32.077 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:32.086 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:32.130 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:32.127+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:32.189 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:32.190 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:32.193 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:32.189+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:32.198 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:32.294 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:32.291+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:32.341 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:32.342 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:32.350 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:32.395 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:32.392+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:32.395 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:03:32.455 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:32.455 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:32.464 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:32.510 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:32.507+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:32.568 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:32.568 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:32.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:32.597 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:32.594+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:32.691 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:32.724 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:32.724 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:32.733 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:32.736 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:32.733+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:32.798 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:32.795+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:32.821 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:32.822 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:32.837 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:32.837 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:32.845 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:32.854 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:32.854 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:32.880 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:32.881 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:32.899 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:32.896+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:32.912 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:32.912 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:32.942 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:32.943 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:32.974 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:32.974 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:32.974 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:32.975 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:32.975 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:32.975 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:32.975 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:32.979 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:32.980 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:32.987 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:33.028 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:33.025+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:33.100 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:33.098+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:33.139 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:33.139 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:33.139 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:33.139 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:33.139 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:33.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:33.201 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:33.199+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:33.259 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.8351854, 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.264 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.834738487999999, 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.266 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:33.268 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.818059847000001, 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.270 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:33.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.273 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.817506176999999, 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.274 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.275 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:33.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:33.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.816894552999997, 2024-09-17T23:03:33.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:33.280 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.282 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.816241853999998, 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.283 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:33.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:33.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:33.287 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.815705714000003, 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:33.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:33.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.800902516999997, 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.292 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.800559833999998, 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:33.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:33.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.799990449000006, 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:33.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:33.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.797510266000003, 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:33.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:33.310 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.7900068, 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:33.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.789505355000003, 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:33.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:33.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:33.319 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.786869633999999, 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:33.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.779011963000002, 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.324 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:33.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.640906138999995, 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:33.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:33.333 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.231603738999993, 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:33.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:33.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.337 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.230089352999997, 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 70.726255859999995, 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:33.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:33.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:33.347 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 70.720854739999993, 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:33.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:33.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:33.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:33.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.352 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.352 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.352 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:33.353 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:33.354 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:33.351+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:33.454 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:33.452+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:33.465 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:33.465 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:33.466 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:33.466 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:33.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:33.555 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:33.552+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:33.586 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:33.586 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:33.586 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:33.586 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:33.586 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:33.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:33.655 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:33.652+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:33.705 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:33.705 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:33.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:33.705 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:33.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.705 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:03:33.705 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 67.464339199999998, 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:03:33.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 24.112717545999999, 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00018986200000000001, 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:33.711 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 2 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:33.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590637+0000", 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3290000000000001e-06 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590646+0000", 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6519999999999995e-06 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590660+0000", 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3485e-05 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590672+0000", 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2531000000000001e-05 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:33.714 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590734+0000", 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1989999999999994e-05 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590825+0000", 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.0875e-05 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:33.715 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:33.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:33.757 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:33.754+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:33.857 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:33.854+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:33.867 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:33.867 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:33.867 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:33.867 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:33.876 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:33.958 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:33.956+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:34.025 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:34.025 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:34.025 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:34.025 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:34.025 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:34.034 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:34.078 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:34.075+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:34.143 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:34.143 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:34.143 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:34.152 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:34.196 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:34.194+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:34.261 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:34.258+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:34.267 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:34.267 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:34.267 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:34.267 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:34.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:34.362 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:34.360+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:34.414 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:03:34.421 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:34.421 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:34.421 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:34.421 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:34.422 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:34.430 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:34.463 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:34.460+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:34.564 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:34.562+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:34.574 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:34.574 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:34.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:34.575 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:34.575 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:34.583 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:34.665 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:34.662+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:34.726 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:34.727 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:34.727 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:34.727 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:34.735 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:34.766 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:34.763+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:34.839 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:34.839 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:34.839 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:34.839 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:34.839 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:34.848 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:34.867 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:34.864+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:34.951 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:34.951 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:34.951 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:34.951 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:34.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.951 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 68.712457170999997, 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:34.953 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:34.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.957 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:1 2.3 e19/18 ondisk, result = 0)", 2024-09-17T23:03:34.958 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 68.708715888, 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013062499999999999, 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240188+0000", 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240189+0000", 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.16e-07 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240199+0000", 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0299000000000001e-05 2024-09-17T23:03:34.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240217+0000", 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7660999999999999e-05 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240228+0000", 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0917999999999999e-05 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240292+0000", 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4339999999999997e-05 2024-09-17T23:03:34.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240301+0000", 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8030000000000003e-06 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240318+0000", 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7688000000000001e-05 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 68.703853272000003, 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019582000000000001, 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.963 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245050+0000", 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245052+0000", 2024-09-17T23:03:34.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2020000000000001e-06 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245057+0000", 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5400000000000003e-06 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245071+0000", 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.416e-05 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245081+0000", 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9010000000000006e-06 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245140+0000", 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8369000000000003e-05 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245246+0000", 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000106648 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.966 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 68.703421282999997, 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014068800000000001, 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:34.967 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245482+0000", 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245484+0000", 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1909999999999999e-06 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245490+0000", 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5060000000000001e-06 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245502+0000", 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2320000000000001e-05 2024-09-17T23:03:34.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245509+0000", 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5139999999999998e-06 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245552+0000", 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2933999999999999e-05 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.245623+0000", 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1223000000000006e-05 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.710955208000001, 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:34.971 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:34.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:34.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:5 2.2 e19/18 ondisk, result = 0)", 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.707809423, 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019095900000000001, 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.978 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241094+0000", 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241095+0000", 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3600000000000003e-07 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241103+0000", 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1550000000000007e-06 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241114+0000", 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0651e-05 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241138+0000", 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4029e-05 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241198+0000", 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0637000000000002e-05 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:34.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241205+0000", 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0839999999999997e-06 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241285+0000", 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0667000000000005e-05 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:34.982 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.705080283000001, 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:34.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:34.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:34.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop_reply(client.4290.0:7 2.2 e20/18 ondisk, result = 0)", 2024-09-17T23:03:34.989 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.701657456999996, 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7009000000000006e-05, 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247246+0000", 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247247+0000", 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0210000000000001e-06 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247253+0000", 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2970000000000003e-06 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247265+0000", 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247271+0000", 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4860000000000002e-06 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247320+0000", 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8115999999999998e-05 2024-09-17T23:03:34.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247329+0000", 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9320000000000002e-06 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247343+0000", 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4667e-05 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4201.0:1 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.360110245000001, 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00023331, 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4201", 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:34.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588793+0000", 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588795+0000", 2024-09-17T23:03:34.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.722e-06 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588801+0000", 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2779999999999999e-06 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588811+0000", 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6379999999999999e-06 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588820+0000", 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4759999999999998e-06 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.588910+0000", 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0679000000000004e-05 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:09.589027+0000", 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000116517 2024-09-17T23:03:34.997 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.998 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:34.998 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:34.998 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:34.998 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:35.000 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:35.000 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:34.997+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:35.100 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:35.097+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:35.124 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:35.124 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:35.141 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:35.142 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:35.145 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:35.145 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:35.145 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:35.145 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:35.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:35.158 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:35.158 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:35.175 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:35.176 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:35.192 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:35.192 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:35.201 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:35.197+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:35.209 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:35.210 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:35.210 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:35.213 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:35.213 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:35.257 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:35.257 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:35.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:35.301 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:35.298+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:35.370 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:35.371 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:35.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:35.397 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:03:35.402 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:35.400+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:35.492 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:35.492 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:35.501 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:35.503 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:35.500+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:35.604 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:35.602+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:35.609 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:35.609 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:35.619 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:35.705 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:35.702+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:35.729 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:35.729 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:35.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:35.805 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:35.803+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:35.846 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:35.846 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:35.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:35.906 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:35.903+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:35.963 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:35.963 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:35.972 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:35.973 INFO:tasks.workunit.client.0.smithi005.stderr:Updating files: 92% (11888/12893) Updating files: 93% (11991/12893) Updating files: 94% (12120/12893) Updating files: 95% (12249/12893) Updating files: 96% (12378/12893) Updating files: 97% (12507/12893) Updating files: 98% (12636/12893) Updating files: 99% (12765/12893) Updating files: 100% (12893/12893) Updating files: 100% (12893/12893), done. 2024-09-17T23:03:35.977 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7] live_osds: [0, 2, 3, 4, 5, 6] 2024-09-17T23:03:35.977 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:03:35.977 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T23:03:35.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T23:03:36.016 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:36.013+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:36.085 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:36.085 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:36.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:36.108 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:36.106+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:36.208 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:36.206+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:36.232 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:36.232 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:36.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:36.310 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:36.307+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:36.348 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 47, 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "4cb0491c-5273-43ce-9711-0f68bec58f2e", 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-09-17T23:02:05.418126+0000", 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-09-17T23:03:35.389890+0000", 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "last_up_change": "2024-09-17T23:03:14.321077+0000", 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "last_in_change": "2024-09-17T23:03:01.271643+0000", 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_num": 5801984, 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_set": [ 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "noscrub", 2024-09-17T23:03:36.349 INFO:teuthology.orchestra.run.smithi005.stdout: "pglog_hardlimit", 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "purged_snapdirs", 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_deletes", 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "sortbitwise" 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_version": 4, 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_snapshot": "", 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_max": 2, 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd": 8, 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "require_min_compat_client": "luminous", 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "min_compat_client": "luminous", 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "require_osd_release": "squid", 2024-09-17T23:03:36.350 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_crimson": false, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": [ 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 1, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": ".mgr", 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:19.615759+0000", 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool", 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:03:36.351 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 1, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 1, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 1, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 1, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 1, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:03:36.352 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "17", 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 0, 2024-09-17T23:03:36.353 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 0, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:03:36.354 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:03:36.355 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "options": { 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_max": 32, 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_min": 1 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": {} 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:03:36.356 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 7.690000057220459, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 7.690000057220459, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 1, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 1, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 1, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 1, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 1 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 2, 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": "rbd", 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:24.412869+0000", 2024-09-17T23:03:36.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 8193, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:03:36.358 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 8, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 8, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 8, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 8, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 8, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.359 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "21", 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 2, 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 21, 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:03:36.360 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:03:36.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "options": {}, 2024-09-17T23:03:36.362 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd": {} 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable", 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 0, 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 0 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "69fa22ee-5c14-4f80-82fe-b22939183e4a", 2024-09-17T23:03:36.363 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 39, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.364 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.365 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6802", 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6803", 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6806", 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6807", 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6804", 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6805", 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6801/3261733059", 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6803/3261733059", 2024-09-17T23:03:36.368 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6807/3261733059", 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6805/3261733059", 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "a50256db-895f-4a6b-b83e-e251a3b53e10", 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:36.369 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 18, 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 22, 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6816", 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6817", 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6818", 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6819", 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6822", 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.372 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6823", 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6820", 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.373 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6821", 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6817/3745424715", 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6819/3745424715", 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6823/3745424715", 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6821/3745424715", 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:03:36.374 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2", 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 36, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.375 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6824", 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6825", 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.376 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6826", 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6827", 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.377 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6830", 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6831", 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.378 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6828", 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6829", 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6825/3492189306", 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6827/3492189306", 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6831/3492189306", 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6829/3492189306", 2024-09-17T23:03:36.379 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "b9664ac0-db52-42bb-aa10-9ad23cc7021a", 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:36.380 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 0, 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6808", 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6809", 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:36.381 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6810", 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.382 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6811", 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6814", 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:36.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6815", 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6812", 2024-09-17T23:03:36.384 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6813", 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6809/1475101831", 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6811/1475101831", 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6815/1475101831", 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6813/1475101831", 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:36.385 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "5a11b2ff-7a67-40ed-8076-90ce187a3d96", 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:36.386 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 0, 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6810", 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6811", 2024-09-17T23:03:36.387 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6812", 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.388 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6813", 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6816", 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.389 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6817", 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6814", 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.390 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6815", 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6811/1406375140", 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6813/1406375140", 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6817/1406375140", 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6815/1406375140", 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "2361e4e6-f10b-417b-a976-a037ac890e11", 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:36.392 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6818", 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6819", 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.393 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6820", 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6821", 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.394 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6824", 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6825", 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.395 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6822", 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6823", 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6819/2095030613", 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6821/2095030613", 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6825/2095030613", 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6823/2095030613", 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "8d3a457f-9981-4307-ac8e-4d45f1600ade", 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:36.397 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 39, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6802", 2024-09-17T23:03:36.398 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6803", 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6804", 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:36.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6805", 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6808", 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:36.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6809", 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6806", 2024-09-17T23:03:36.401 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6807", 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6803/3030792595", 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6805/3030792595", 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6809/3030792595", 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6807/3030792595", 2024-09-17T23:03:36.402 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3", 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:36.403 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 39, 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6826", 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.404 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6827", 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6828", 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.405 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6829", 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6832", 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.406 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6833", 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6830", 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6831", 2024-09-17T23:03:36.407 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6827/967279289", 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6829/967279289", 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6833/967279289", 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6831/967279289", 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_xinfo": [ 2024-09-17T23:03:36.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.899917+0000", 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:36.409 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.157860+0000", 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 22 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.416164+0000", 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:36.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.907974+0000", 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:36.411 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.523463+0000", 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.326314+0000", 2024-09-17T23:03:36.412 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.363775+0000", 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:03:36.413 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.492325+0000", 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 39 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap": [ 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.5", 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:03:36.414 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: 0 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_items": [], 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_primaries": [], 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_temp": [], 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_temp": [], 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklist": {}, 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "range_blocklist": {}, 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profiles": { 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "default": { 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-failure-domain": "osd", 2024-09-17T23:03:36.415 INFO:teuthology.orchestra.run.smithi005.stdout: "k": "2", 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "m": "1", 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin": "jerasure", 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "technique": "reed_sol_van" 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps_queue": [], 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "new_removed_snaps": [], 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "new_purged_snaps": [], 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_node_flags": {}, 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "device_class_flags": {}, 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": { 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_enabled": false, 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_bucket_count": 0, 2024-09-17T23:03:36.416 INFO:teuthology.orchestra.run.smithi005.stdout: "degraded_stretch_mode": 0, 2024-09-17T23:03:36.417 INFO:teuthology.orchestra.run.smithi005.stdout: "recovering_stretch_mode": 0, 2024-09-17T23:03:36.417 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_bucket": 0 2024-09-17T23:03:36.417 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:36.417 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:36.418 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:36.419 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:36.419 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:36.421 INFO:tasks.thrashosds.thrasher:j is {'epoch': 47, 'fsid': '4cb0491c-5273-43ce-9711-0f68bec58f2e', 'created': '2024-09-17T23:02:05.418126+0000', 'modified': '2024-09-17T23:03:35.389890+0000', 'last_up_change': '2024-09-17T23:03:14.321077+0000', 'last_in_change': '2024-09-17T23:03:01.271643+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T23:02:19.615759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T23:02:24.412869+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '69fa22ee-5c14-4f80-82fe-b22939183e4a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6800', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6801', 'nonce': 3261733059}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6802', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6803', 'nonce': 3261733059}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6806', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6807', 'nonce': 3261733059}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6804', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6805', 'nonce': 3261733059}]}, 'public_addr': '172.21.15.5:6801/3261733059', 'cluster_addr': '172.21.15.5:6803/3261733059', 'heartbeat_back_addr': '172.21.15.5:6807/3261733059', 'heartbeat_front_addr': '172.21.15.5:6805/3261733059', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a50256db-895f-4a6b-b83e-e251a3b53e10', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 22, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6816', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6817', 'nonce': 3745424715}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6818', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6819', 'nonce': 3745424715}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6822', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6823', 'nonce': 3745424715}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6820', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6821', 'nonce': 3745424715}]}, 'public_addr': '172.21.15.5:6817/3745424715', 'cluster_addr': '172.21.15.5:6819/3745424715', 'heartbeat_back_addr': '172.21.15.5:6823/3745424715', 'heartbeat_front_addr': '172.21.15.5:6821/3745424715', 'state': ['exists']}, {'osd': 2, 'uuid': 'c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 36, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6824', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6825', 'nonce': 3492189306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6826', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6827', 'nonce': 3492189306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6830', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6831', 'nonce': 3492189306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6828', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6829', 'nonce': 3492189306}]}, 'public_addr': '172.21.15.5:6825/3492189306', 'cluster_addr': '172.21.15.5:6827/3492189306', 'heartbeat_back_addr': '172.21.15.5:6831/3492189306', 'heartbeat_front_addr': '172.21.15.5:6829/3492189306', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': 'b9664ac0-db52-42bb-aa10-9ad23cc7021a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6808', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6809', 'nonce': 1475101831}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6810', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6811', 'nonce': 1475101831}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6814', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6815', 'nonce': 1475101831}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6812', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6813', 'nonce': 1475101831}]}, 'public_addr': '172.21.15.5:6809/1475101831', 'cluster_addr': '172.21.15.5:6811/1475101831', 'heartbeat_back_addr': '172.21.15.5:6815/1475101831', 'heartbeat_front_addr': '172.21.15.5:6813/1475101831', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5a11b2ff-7a67-40ed-8076-90ce187a3d96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6810', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6811', 'nonce': 1406375140}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6812', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6813', 'nonce': 1406375140}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6816', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6817', 'nonce': 1406375140}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6814', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6815', 'nonce': 1406375140}]}, 'public_addr': '172.21.15.152:6811/1406375140', 'cluster_addr': '172.21.15.152:6813/1406375140', 'heartbeat_back_addr': '172.21.15.152:6817/1406375140', 'heartbeat_front_addr': '172.21.15.152:6815/1406375140', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2361e4e6-f10b-417b-a976-a037ac890e11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6818', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6819', 'nonce': 2095030613}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6820', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6821', 'nonce': 2095030613}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6824', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6825', 'nonce': 2095030613}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6822', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6823', 'nonce': 2095030613}]}, 'public_addr': '172.21.15.152:6819/2095030613', 'cluster_addr': '172.21.15.152:6821/2095030613', 'heartbeat_back_addr': '172.21.15.152:6825/2095030613', 'heartbeat_front_addr': '172.21.15.152:6823/2095030613', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8d3a457f-9981-4307-ac8e-4d45f1600ade', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6802', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6803', 'nonce': 3030792595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6804', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6805', 'nonce': 3030792595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6808', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6809', 'nonce': 3030792595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6806', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6807', 'nonce': 3030792595}]}, 'public_addr': '172.21.15.152:6803/3030792595', 'cluster_addr': '172.21.15.152:6805/3030792595', 'heartbeat_back_addr': '172.21.15.152:6809/3030792595', 'heartbeat_front_addr': '172.21.15.152:6807/3030792595', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 39, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6826', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6827', 'nonce': 967279289}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6828', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6829', 'nonce': 967279289}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 967279289}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6830', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6831', 'nonce': 967279289}]}, 'public_addr': '172.21.15.152:6827/967279289', 'cluster_addr': '172.21.15.152:6829/967279289', 'heartbeat_back_addr': '172.21.15.152:6833/967279289', 'heartbeat_front_addr': '172.21.15.152:6831/967279289', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.899917+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.157860+0000', 'dead_epoch': 22}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.416164+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.907974+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.523463+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.326314+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.363775+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.492325+0000', 'dead_epoch': 39}], 'pg_upmap': [{'pgid': '2.5', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T23:03:36.421 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-17T23:03:36.421 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:36.416+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:36.519 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:36.516+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:36.568 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:36.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:36.621 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:36.619+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:36.693 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:36.693 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:36.703 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:36.720 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:36.717+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:36.821 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:36.819+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:36.848 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:36.848 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:36.857 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:36.922 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:36.918+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr:Note: switching to 'b0d356b98e08f6bc59ef15652f0d0e4298fc83c7'. 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr:state without impacting any branches by switching back to a branch. 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr: git switch -c 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-17T23:03:36.967 INFO:tasks.workunit.client.0.smithi005.stderr:Or undo this operation with: 2024-09-17T23:03:36.968 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-17T23:03:36.968 INFO:tasks.workunit.client.0.smithi005.stderr: git switch - 2024-09-17T23:03:36.968 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-17T23:03:36.968 INFO:tasks.workunit.client.0.smithi005.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-17T23:03:36.968 INFO:tasks.workunit.client.0.smithi005.stderr: 2024-09-17T23:03:36.968 INFO:tasks.workunit.client.0.smithi005.stderr:HEAD is now at b0d356b98e0 Merge pull request #59811 from afreen23/wip-68079-squid 2024-09-17T23:03:36.972 DEBUG:teuthology.orchestra.run.smithi005:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-17T23:03:37.000 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:37.000 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:37.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:37.039 INFO:tasks.workunit.client.0.smithi005.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-17T23:03:37.039 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:37.036+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:37.041 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T23:03:37.041 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-17T23:03:37.111 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:37.111 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:37.120 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:37.164 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:37.162+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:37.215 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:37.222 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:37.222 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:37.231 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:37.259 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:37.256+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:37.324 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:37.321+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:37.340 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:37.340 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:37.340 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:37.357 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:37.357 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:37.373 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:37.374 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:37.376 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:37.376 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:37.384 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:37.390 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:37.390 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:37.407 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:37.408 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:37.413 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:03:37.426 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:37.426 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:37.426 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:37.428 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:37.426+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:37.430 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:37.430 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:37.490 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:37.490 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:37.490 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:37.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:37.540 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:37.538+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:37.627 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:37.624+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:37.643 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:37.643 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:37.644 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:37.644 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:37.644 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:37.653 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:37.657 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-17T23:03:37.729 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:37.726+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:37.739 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-17T23:03:37.762 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:37.762 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:37.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:37.763 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:37.763 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:37.771 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:37.780 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-17T23:03:37.782 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T23:03:37.782 INFO:tasks.workunit.client.0.smithi005.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-17T23:03:37.822 INFO:tasks.workunit.client.0.smithi005.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-17T23:03:37.826 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-09-17T23:03:37.826 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-17T23:03:37.869 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:37.865+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:37.879 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:37.879 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:37.880 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:37.880 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:37.884 INFO:tasks.workunit:Running workunits matching rbd/journal.sh on client.0... 2024-09-17T23:03:37.886 INFO:tasks.workunit:Running workunit rbd/journal.sh... 2024-09-17T23:03:37.886 DEBUG:teuthology.orchestra.run.smithi005:workunit test rbd/journal.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0d356b98e08f6bc59ef15652f0d0e4298fc83c7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/journal.sh 2024-09-17T23:03:37.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:37.914 INFO:tasks.workunit.client.0.smithi005.stderr:stty: 'standard input': Inappropriate ioctl for device 2024-09-17T23:03:37.920 INFO:tasks.workunit.client.0.smithi005.stderr:+ test_rbd_journal 2024-09-17T23:03:37.920 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdjournal53757 2024-09-17T23:03:37.921 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd create --image-feature exclusive-lock --image-feature journaling --size 128 testrbdjournal53757 2024-09-17T23:03:37.933 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:37.930+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:37.976 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd info testrbdjournal53757 --format=xml 2024-09-17T23:03:37.976 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //image/journal 2024-09-17T23:03:38.002 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:38.003 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:38.003 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:38.003 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:38.003 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:38.012 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:38.035 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:38.032+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:38.044 INFO:tasks.workunit.client.0.smithi005.stderr:+ local journal=132cc2a15bff 2024-09-17T23:03:38.045 INFO:tasks.workunit.client.0.smithi005.stderr:+ test -n 132cc2a15bff 2024-09-17T23:03:38.045 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal info 132cc2a15bff 2024-09-17T23:03:38.078 INFO:tasks.workunit.client.0.smithi005.stdout:rbd journal '132cc2a15bff': 2024-09-17T23:03:38.078 INFO:tasks.workunit.client.0.smithi005.stdout: header_oid: journal.132cc2a15bff 2024-09-17T23:03:38.078 INFO:tasks.workunit.client.0.smithi005.stdout: object_oid_prefix: journal_data.2.132cc2a15bff. 2024-09-17T23:03:38.078 INFO:tasks.workunit.client.0.smithi005.stdout: order: 24 (16 MiB objects) 2024-09-17T23:03:38.078 INFO:tasks.workunit.client.0.smithi005.stdout: splay_width: 4 2024-09-17T23:03:38.080 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal info --journal 132cc2a15bff 2024-09-17T23:03:38.115 INFO:tasks.workunit.client.0.smithi005.stdout:rbd journal '132cc2a15bff': 2024-09-17T23:03:38.116 INFO:tasks.workunit.client.0.smithi005.stdout: header_oid: journal.132cc2a15bff 2024-09-17T23:03:38.116 INFO:tasks.workunit.client.0.smithi005.stdout: object_oid_prefix: journal_data.2.132cc2a15bff. 2024-09-17T23:03:38.116 INFO:tasks.workunit.client.0.smithi005.stdout: order: 24 (16 MiB objects) 2024-09-17T23:03:38.116 INFO:tasks.workunit.client.0.smithi005.stdout: splay_width: 4 2024-09-17T23:03:38.118 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal info --image testrbdjournal53757 2024-09-17T23:03:38.135 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:38.133+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:38.156 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:38.157 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:38.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:38.157 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:38.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.157 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:38.157 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:38.157 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.732208787999994, 2024-09-17T23:03:38.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:38.162 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.731761875999993, 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:38.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.715083234999994, 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.167 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:38.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:38.171 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.714529565000007, 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:38.174 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.713917941000005, 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.176 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:38.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.179 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:38.180 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.713265242000006, 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.181 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.182 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:38.184 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.712729101999997, 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.185 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:38.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:38.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:38.189 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.697925905000005, 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:38.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.191 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:38.193 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.697583222000006, 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:38.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.197 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:38.198 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.697013837, 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:38.199 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:38.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:38.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.203 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.203 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:38.203 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:38.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.204 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.694533653999997, 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.687030187999994, 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.686528742999997, 2024-09-17T23:03:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.683893022000007, 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.676035350999996, 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.537929527000003, 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:131 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=16'85)", 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.128627127000001, 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089103000000000001, 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024205+0000", 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024206+0000", 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024267+0000", 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1736999999999995e-05 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024278+0000", 2024-09-17T23:03:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0212e-05 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024284+0000", 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1410000000000002e-06 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024317+0000", 2024-09-17T23:03:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3055000000000001e-05 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.024328+0000", 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.136e-05 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025067+0000", 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000739154 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025096+0000", 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8790999999999999e-05 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.127112741000005, 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 75.623279248000003, 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 75.617878128000001, 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.259 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:38.261 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:38.261 INFO:tasks.workunit.client.0.smithi005.stdout:rbd journal '132cc2a15bff': 2024-09-17T23:03:38.261 INFO:tasks.workunit.client.0.smithi005.stdout: header_oid: journal.132cc2a15bff 2024-09-17T23:03:38.261 INFO:tasks.workunit.client.0.smithi005.stdout: object_oid_prefix: journal_data.2.132cc2a15bff. 2024-09-17T23:03:38.262 INFO:tasks.workunit.client.0.smithi005.stdout: order: 24 (16 MiB objects) 2024-09-17T23:03:38.262 INFO:tasks.workunit.client.0.smithi005.stdout: splay_width: 4 2024-09-17T23:03:38.262 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd feature disable testrbdjournal53757 journaling 2024-09-17T23:03:38.262 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:38.258+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:38.362 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:38.359+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:38.407 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:03:38.410 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:38.410 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:38.410 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:38.410 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:38.420 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:38.462 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:38.460+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:38.564 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:38.561+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:38.568 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:38.568 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:38.568 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:38.568 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:38.568 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:38.577 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:38.664 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:38.662+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:38.684 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:38.684 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4290.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 72.443558667999994, 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011212570000000001, 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:38.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239013+0000", 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239014+0000", 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1100000000000001e-07 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239020+0000", 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2360000000000001e-06 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239033+0000", 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3315e-05 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239046+0000", 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2265e-05 2024-09-17T23:03:38.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239132+0000", 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6382000000000001e-05 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.239162+0000", 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9779999999999999e-05 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240094+0000", 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093183299999999997 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:26.240135+0000", 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1035000000000003e-05 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.689 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37)", 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 29.091937013999999, 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00018986200000000001, 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 2 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590635+0000", 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590637+0000", 2024-09-17T23:03:38.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3290000000000001e-06 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590646+0000", 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6519999999999995e-06 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590660+0000", 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3485e-05 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590672+0000", 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2531000000000001e-05 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590734+0000", 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1989999999999994e-05 2024-09-17T23:03:38.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:09.590825+0000", 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.0875e-05 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4908.0:7 2.3 e47/18 2:d000243d:::rbd_header.132cc2a15bff:head v 47'2, mlcod=0'0)", 2024-09-17T23:03:38.694 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.965574+0000", 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.71699795899999996, 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074293600000000003, 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.965574+0000", 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.965574+0000", 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.965575+0000", 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.003e-06 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.965584+0000", 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6889999999999993e-06 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.965598+0000", 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4623e-05 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.965607+0000", 2024-09-17T23:03:38.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.1089999999999998e-06 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.965667+0000", 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0087000000000003e-05 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.965690+0000", 2024-09-17T23:03:38.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3697999999999999e-05 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.966272+0000", 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00058177900000000004 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.966317+0000", 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4947999999999997e-05 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4941.0:12 2.3 e47/18 2:d000243d:::rbd_header.132cc2a15bff:head v 47'3, mlcod=19'1)", 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:38.208985+0000", 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.47358722599999997, 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064318399999999999, 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.700 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.208985+0000", 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.208985+0000", 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.208986+0000", 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.649e-06 2024-09-17T23:03:38.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.209003+0000", 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6246999999999999e-05 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.209022+0000", 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8842999999999999e-05 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.209030+0000", 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2989999999999997e-06 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.209085+0000", 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5169e-05 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.209103+0000", 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7856e-05 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.209564+0000", 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000460956 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.209628+0000", 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.4165000000000007e-05 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4941.0:14 2.3 e47/18 2:d000243d:::rbd_header.132cc2a15bff:head v 47'4, mlcod=47'2)", 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:38.210530+0000", 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.47204217799999998, 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00040844299999999998, 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210530+0000", 2024-09-17T23:03:38.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210530+0000", 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210530+0000", 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.8299999999999997e-07 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210537+0000", 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5459999999999997e-06 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210547+0000", 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.8700000000000004e-06 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210552+0000", 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7949999999999998e-06 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210587+0000", 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.5612999999999999e-05 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210600+0000", 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2472e-05 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210901+0000", 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00030140400000000002 2024-09-17T23:03:38.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.210938+0000", 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7160000000000003e-05 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "pg_update_log_missing(2.3 epoch 47/18 rep_tid 11 entries 47'5 (0'0) error 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head by client.4941.0:25 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 47'3)", 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:38.215059+0000", 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.46751342000000001, 2024-09-17T23:03:38.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00045503900000000002, 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.215059+0000", 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.215059+0000", 2024-09-17T23:03:38.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.215059+0000", 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3900000000000004e-07 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.215067+0000", 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.661e-06 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:38.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.215083+0000", 2024-09-17T23:03:38.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.643e-05 2024-09-17T23:03:38.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:38.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.215094+0000", 2024-09-17T23:03:38.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0875e-05 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.215147+0000", 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2689000000000003e-05 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:38.215514+0000", 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00036674500000000003 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.714 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:38.714 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:38.714 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:38.715 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:38.799 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:38.797+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:38.862 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:38.862 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:38.863 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:38.863 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:38.866 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:38.864+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:38.871 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:38.967 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:38.965+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:39.018 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:39.018 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:39.019 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:39.019 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:39.027 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:39.067 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:39.065+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:39.134 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:39.134 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:39.134 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:39.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:39.169 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:39.167+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:39.256 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:39.256 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:39.256 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:39.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:39.270 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:39.267+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:39.368 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:39.368 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:39.368 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:39.368 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:39.369 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:39.371 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:39.368+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:39.377 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:39.431 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:39.471 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:39.469+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:39.521 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:39.522 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:39.530 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:39.557 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:39.557 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:39.557 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:39.572 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:39.570+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:39.574 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2: {} 2024-09-17T23:03:39.574 INFO:teuthology.orchestra.run.smithi005.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-17T23:03:39.591 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:39.591 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:39.608 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:39.608 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:39.624 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:39.625 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:39.642 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:39.642 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:39.645 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:39.646 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:39.673 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:39.671+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:39.676 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:39.676 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:39.685 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:39.774 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:39.772+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:39.827 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:39.828 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:39.836 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:39.880 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:39.878+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:39.939 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:39.940 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:39.949 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:39.990 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:39.988+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:40.076 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:40.074+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:40.093 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:40.093 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:40.102 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:40.178 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:40.175+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:40.204 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:40.204 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:40.213 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:40.278 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:40.276+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:40.315 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:40.315 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:40.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:40.379 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:40.377+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:40.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:03:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:40.445 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:40.455 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:40.480 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:40.478+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:40.581 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:40.578+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:40.605 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:40.605 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:40.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:40.698 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:40.696+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:40.761 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:40.762 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:40.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:03:40.783 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:40.780+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:40.883 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:40.881+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:40.917 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:40.917 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:40.926 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-17T23:03:40.983 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:03:40.981+0000 7f48fa3a7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 33348) UID: 0 2024-09-17T23:03:41.032 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:41.032 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:41.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-17T23:03:41.084 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:41.082+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:41.184 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:41.182+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:41.188 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:41.188 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:41.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:41.285 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:41.282+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:41.344 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:41.344 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:41.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:41.393 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:41.391+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:41.409 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:03:41.421 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7] live_osds: [0, 2, 3, 4, 5, 6] 2024-09-17T23:03:41.421 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:03:41.421 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 2, 3, 4, 5, 6] 2024-09-17T23:03:41.422 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T23:03:41.422 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:03:41.456 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T23:03:41.456 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.2 2024-09-17T23:03:41.456 INFO:tasks.thrashosds.thrasher:remote for osd 2 is ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:03:41.456 INFO:tasks.thrashosds.thrasher:remote for exp osd 1 is ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:03:41.457 DEBUG:teuthology.orchestra.run.smithi005:> type ceph-objectstore-tool 2024-09-17T23:03:41.498 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:41.496+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:41.504 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:41.504 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:41.512 INFO:teuthology.orchestra.run.smithi005.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-17T23:03:41.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op list-pgs 2024-09-17T23:03:41.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:41.598 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:41.596+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:41.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:41.662 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:41.663 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:41.672 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:41.716 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:41.714+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:41.771 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:41.771 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:41.788 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:41.789 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:41.789 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:41.787+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:41.798 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:41.890 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:41.888+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:41.943 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:41.943 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:41.952 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:41.995 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:41.993+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:42.055 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:42.056 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:42.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:42.092 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:42.090+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:42.193 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:42.191+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:42.208 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:42.209 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:42.218 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:42.294 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:42.292+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:42.322 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:42.322 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:42.331 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:42.416 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:42.414+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:42.423 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:03:42.443 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:42.443 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:42.461 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:42.462 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:42.477 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:42.477 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:42.479 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:42.479 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:42.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:42.496 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:42.497 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:42.500 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:42.500 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:42.527 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:42.525+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:42.594 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:42.594 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:42.594 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:42.595 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:42.597 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:42.595+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:42.603 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:42.698 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:42.696+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:42.709 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:42.710 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:42.710 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:42.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:42.799 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:42.797+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:42.866 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.442761449000002, 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.867 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:42.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.442314537000001, 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:42.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:42.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:42.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:42.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.425635896000003, 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:42.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:42.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.425082226000001, 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:42.881 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:42.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.884 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:42.885 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.424470602, 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:42.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.890 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.423817903, 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:42.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.423281763000006, 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.895 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.899 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.408478565999999, 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:42.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:42.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.408135883, 2024-09-17T23:03:42.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:42.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.407566497999994, 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:42.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.405086315000005, 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.397582849000003, 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:42.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.922 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.397081404000005, 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:42.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:42.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.394445683000001, 2024-09-17T23:03:42.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:42.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:42.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.386588012000004, 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:42.932 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:42.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.936 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 81.248482187999997, 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:42.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:42.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 80.837665401999999, 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:42.941 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:42.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.945 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 80.333831908999997, 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:42.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 80.328430788999995, 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.950 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:42.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 4.9007319410000001, 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:03:42.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:42.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:03:42.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:42.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:03:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:03:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:42.960 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:42.960 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:42.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:42.962 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:42.959+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:43.062 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:43.060+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:43.109 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:43.109 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:43.109 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:43.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:43.163 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:43.161+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:43.264 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:43.261+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:43.265 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:43.265 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:43.265 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:43.265 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:43.265 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:43.274 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:43.364 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:43.362+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:43.380 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:43.381 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:43.381 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:43.381 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:43.381 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:43.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:43.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:03:43.442 INFO:teuthology.orchestra.run.smithi005.stdout:2.6 2024-09-17T23:03:43.442 INFO:teuthology.orchestra.run.smithi005.stdout:2.4 2024-09-17T23:03:43.442 INFO:teuthology.orchestra.run.smithi005.stdout:2.2 2024-09-17T23:03:43.442 INFO:teuthology.orchestra.run.smithi005.stdout:2.0 2024-09-17T23:03:43.465 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:43.463+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:43.503 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:43.504 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:43.504 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:43.512 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:43.566 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:43.564+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:43.617 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:43.617 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:43.618 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:43.618 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:43.618 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:43.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:43.667 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:43.665+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:43.768 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:43.766+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:43.768 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:43.769 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:43.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:43.769 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:43.769 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:43.777 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:43.869 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:43.867+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:43.921 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:43.921 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:43.921 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:43.921 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:43.930 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:43.958 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --op export --pgid 2.4 --file /var/log/ceph/exp.2.4.1 2024-09-17T23:03:43.973 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:43.971+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:44.033 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:44.033 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:44.034 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:44.034 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:44.034 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:44.042 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:44.083 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:44.081+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:44.171 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:44.169+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:44.187 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 77.947909359999997, 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:44.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:44.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:44.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:44.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 76.946407397000002, 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.195 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.197 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:44.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.940532472000001, 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:44.201 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.202 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:44.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:44.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:44.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:3 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.961621+0000", 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.2227351950000003, 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027907799999999999, 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 3 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.208 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961621+0000", 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961621+0000", 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961622+0000", 2024-09-17T23:03:44.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1960000000000001e-06 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961633+0000", 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1493e-05 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961642+0000", 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4100000000000008e-06 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961649+0000", 2024-09-17T23:03:44.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8009999999999998e-06 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961698+0000", 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9768000000000002e-05 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961785+0000", 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7169000000000005e-05 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.961900+0000", 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011424100000000001 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.2223095800000001, 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.212 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:03:44.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:03:44.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.216 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.219181903, 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:44.217 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:03:44.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.2173328740000002, 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.223 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:44.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:03:44.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.216018794, 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:03:44.232 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.214446261, 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:44.233 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:03:44.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.237 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.1685440390000004, 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:44.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:10 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.1672252209999998, 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028104099999999999, 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.242 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 10 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4300000000000003e-07 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017140+0000", 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.85e-06 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017147+0000", 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.421e-06 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017150+0000", 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.675e-06 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017195+0000", 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5126000000000001e-05 2024-09-17T23:03:44.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017276+0000", 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0903999999999997e-05 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017412+0000", 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013542200000000001 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.246 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.0284307779999997, 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027978299999999997, 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155926+0000", 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6000000000000003e-07 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155929+0000", 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9210000000000001e-06 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155935+0000", 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9649999999999996e-06 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155938+0000", 2024-09-17T23:03:44.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3249999999999999e-06 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155970+0000", 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2051999999999997e-05 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.156017+0000", 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6740000000000003e-05 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.156205+0000", 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018812000000000001 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.9775479330000003, 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.251 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.253 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.255 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.9756551079999998, 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.9741611690000003, 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.261 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:44.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:03:44.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:03:44.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:03:44.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:03:44.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:03:44.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.9722324449999995, 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.270 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:44.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:03:44.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:44.275 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.9703343459999996, 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:44.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.280 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.9695719460000003, 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:03:44.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:03:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.98420576500000001, 2024-09-17T23:03:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:03:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.98407895099999998, 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.296 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.296 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:44.296 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:44.296 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:44.297 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:44.298 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:44.295+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:44.398 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:44.396+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:44.427 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:03:44.442 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:44.442 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:44.442 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:44.442 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:44.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:44.499 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:44.497+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:44.502 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:44.553 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:44.554 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:44.554 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:44.554 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:44.554 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:44.562 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:44.603 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:44.601+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:44.633 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:44.633 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:44.633 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:44.633 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:03:44.651 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:44.651 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:44.669 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:44.669 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:44.686 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:44.686 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:44.701 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:44.699+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:44.704 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:44.705 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:44.708 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:44.708 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:44.708 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:44.709 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:44.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:44.802 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:44.800+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:44.824 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:44.824 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:44.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:44.903 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:44.900+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:44.980 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:44.980 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:44.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:45.003 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:45.001+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:45.095 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:45.095 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:45.104 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:45.104 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:45.101+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:45.205 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:45.203+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:45.252 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:45.252 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:45.260 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:45.306 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:45.304+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:45.367 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:45.368 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:45.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:45.407 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:45.405+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:45.484 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:45.484 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:45.493 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:45.508 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:45.506+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:45.609 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:45.607+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:45.610 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:45.610 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:45.619 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:45.643 INFO:teuthology.orchestra.run.smithi005.stderr:Exporting 2.4 info 2.4( empty local-lis/les=18/19 n=0 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-17T23:03:45.646 INFO:teuthology.orchestra.run.smithi005.stderr:Export successful 2024-09-17T23:03:45.710 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:45.708+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:45.723 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:45.724 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:45.733 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:45.817 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:45.815+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:45.876 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:45.876 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:45.885 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:45.926 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:45.924+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:46.013 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:46.010+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:46.029 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:46.029 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:46.037 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:46.121 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:46.119+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:46.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-1 --journal-path /var/lib/ceph/osd/ceph-1/journal --force --op remove --pgid 2.4 2024-09-17T23:03:46.180 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:46.180 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:46.189 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:46.230 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:46.228+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:46.315 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:46.313+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:46.333 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:46.333 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:46.341 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:46.425 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:46.423+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:46.443 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:03:46.486 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:46.486 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:46.494 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:46.517 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:46.515+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:46.617 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:46.615+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:46.638 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:46.638 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:46.647 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:46.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:46.732 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:46.730+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:46.790 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:46.790 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:46.798 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:46.838 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:46.839 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:46.839 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:46.839 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:03:46.840 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:46.837+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:46.856 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:46.856 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:46.873 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:46.873 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:46.890 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:46.891 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:46.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:46.907 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:46.910 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:46.911 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:46.911 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:46.911 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:46.911 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:46.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:46.920 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:46.918+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:47.020 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:47.018+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:47.067 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:47.067 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:47.067 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:47.068 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:47.068 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:47.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:47.121 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:47.119+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.764126603999998, 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.188 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:47.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:47.191 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.192 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.763679691999997, 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.195 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:47.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.747001050999998, 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:47.197 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:47.200 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.201 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.746447380999996, 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.202 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:47.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.205 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.206 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.745835756999995, 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:47.207 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:47.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.745183057999995, 2024-09-17T23:03:47.211 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.215 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.744646918000001, 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.216 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:47.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:47.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:47.220 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.729843720999995, 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:47.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.222 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.729501037999995, 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.225 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.227 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.728931653000004, 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:47.233 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.726451470000001, 2024-09-17T23:03:47.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:47.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:47.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.238 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.718948003999998, 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:47.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.242 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.718446559, 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.244 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:47.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:47.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.715810837999996, 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:47.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.707953166999999, 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.252 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.253 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:47.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.569847343000006, 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:47.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:47.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.159030556999994, 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.261 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:47.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 84.655197064000006, 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:47.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:47.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 84.649795944000005, 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:47.270 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:47.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 9.2220970960000006, 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.275 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:03:47.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:47.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:03:47.278 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:03:47.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:03:47.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.280 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.280 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:47.280 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:47.280 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:47.281 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:47.282 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:47.279+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:47.382 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:47.380+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:47.389 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:47.389 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:47.389 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:47.389 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:47.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:47.433 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:03:47.483 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:47.481+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:47.508 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:47.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:47.508 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:47.508 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:47.508 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:47.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:47.584 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:47.581+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:47.626 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:47.626 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:47.626 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:47.626 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:47.626 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:47.635 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:47.684 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:47.682+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:47.744 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:47.744 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:47.744 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:47.744 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:47.753 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:47.794 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:47.792+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:47.876 INFO:teuthology.orchestra.run.smithi005.stdout: marking collection for removal 2024-09-17T23:03:47.876 INFO:teuthology.orchestra.run.smithi005.stdout:setting '_remove' omap key 2024-09-17T23:03:47.876 INFO:teuthology.orchestra.run.smithi005.stdout:finish_remove_pgs 2.4_head removing 2.4 2024-09-17T23:03:47.877 INFO:teuthology.orchestra.run.smithi005.stdout:Remove successful 2024-09-17T23:03:47.886 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:47.883+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:47.895 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:47.895 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:47.895 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:47.895 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:47.896 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:47.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:47.987 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:47.984+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:48.008 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:48.008 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:48.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:48.008 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:48.008 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:48.017 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:48.088 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:48.086+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:48.160 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:48.160 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:48.160 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:48.160 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:48.169 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:48.213 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:48.211+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:48.272 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:48.273 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:48.273 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:48.273 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:48.273 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:48.281 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:48.289 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:48.287+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:48.390 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal --op list-pgs 2024-09-17T23:03:48.390 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:48.387+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:48.425 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 82.185958799000005, 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.426 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.427 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:48.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.430 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:48.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:48.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 81.184456835999995, 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.433 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:48.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:48.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.437 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:48.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.439 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.178581910999995, 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.440 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.442 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:48.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.460359019, 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.447 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:03:48.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:03:48.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.457231342, 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:03:48.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:03:48.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:03:48.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:03:48.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.455382312999999, 2024-09-17T23:03:48.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:03:48.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:03:48.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.454068232999999, 2024-09-17T23:03:48.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:03:48.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:03:48.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.466 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.4524957, 2024-09-17T23:03:48.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.472 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.406593478, 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:03:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:03:48.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:10 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.40527466, 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028104099999999999, 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.477 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 10 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:48.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4300000000000003e-07 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017140+0000", 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.85e-06 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017147+0000", 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.421e-06 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017150+0000", 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.675e-06 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017195+0000", 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5126000000000001e-05 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017276+0000", 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0903999999999997e-05 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017412+0000", 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013542200000000001 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.481 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.266480217, 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027978299999999997, 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155926+0000", 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6000000000000003e-07 2024-09-17T23:03:48.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155929+0000", 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9210000000000001e-06 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155935+0000", 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9649999999999996e-06 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155938+0000", 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3249999999999999e-06 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155970+0000", 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2051999999999997e-05 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.156017+0000", 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6740000000000003e-05 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.156205+0000", 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018812000000000001 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.215597372, 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.486 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:03:48.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.213704547000001, 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:03:48.490 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:03:48.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:03:48.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:03:48.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.212210607999999, 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.496 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:03:48.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.210281884, 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:03:48.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:03:48.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.208383785000001, 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:03:48.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:03:48.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:03:48.511 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.207621384999999, 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.512 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:03:48.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.516 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.2222552039999997, 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:03:48.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:03:48.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.521 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.22212839, 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:03:48.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.22132916999999999, 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:03:48.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.531 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:48.533 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:48.533 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:48.530+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:48.634 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:48.632+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:48.636 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:48.636 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:48.636 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:48.636 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:48.645 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:48.735 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:48.733+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:48.747 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:48.748 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:48.748 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:48.748 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:48.748 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:48.757 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:48.841 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:48.839+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:48.901 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:48.901 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.940058101, 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:48.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:03:48.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.905 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.906 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.934861622, 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.907 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.908 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.909 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:03:48.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.932050494, 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.912 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.913 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:03:48.914 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:03:48.915 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.888418183000001, 2024-09-17T23:03:48.916 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:48.917 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.918 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:03:48.919 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:03:48.920 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.888077063000001, 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.921 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.922 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:03:48.923 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.924 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.925 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.88067697, 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.926 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.929 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.745462249999999, 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.930 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:03:48.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.932 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:03:48.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.745161001, 2024-09-17T23:03:48.934 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:48.935 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.936 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:03:48.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.694752202, 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.940 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.941 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:03:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.943 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.694435529, 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.944 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:48.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.946 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.948 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.948 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:03:48.948 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:03:48.948 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.948 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.948 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.687395112000001, 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:03:48.949 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.950 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.951 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.952 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.687118744999999, 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.953 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 10.683835508, 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:03:48.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:03:48.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:48.961 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:48.962 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:48.963 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:48.961+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:48.963 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:49.063 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:49.061+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:49.078 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:49.078 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:49.078 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:49.078 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:49.087 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:49.094 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:49.094 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:03:49.111 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:49.112 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:49.129 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:49.129 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:49.147 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:49.147 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:49.164 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:49.162+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:49.171 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:49.171 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:49.176 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:49.176 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:49.210 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:49.210 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:49.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:49.265 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:49.263+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:49.369 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:49.370 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:49.370 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:49.367+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:49.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:49.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:03:49.471 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:49.469+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:49.524 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:49.524 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:49.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:49.576 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:49.574+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:49.655 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:49.655 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:49.665 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:49.674 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:49.672+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:49.774 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:49.772+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:49.813 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:49.813 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:49.821 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:49.875 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:49.873+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:49.929 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:49.929 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:49.938 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:49.979 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:49.977+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:50.077 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:50.075+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:50.080 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:50.080 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:50.089 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:50.178 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:50.176+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:50.193 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:50.193 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:50.202 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:50.244 INFO:teuthology.orchestra.run.smithi005.stdout:2.5 2024-09-17T23:03:50.244 INFO:teuthology.orchestra.run.smithi005.stdout:2.3 2024-09-17T23:03:50.244 INFO:teuthology.orchestra.run.smithi005.stdout:2.1 2024-09-17T23:03:50.286 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:50.284+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:50.344 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:50.345 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:50.353 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:50.379 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:50.377+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:50.447 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:03:50.481 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:50.478+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:50.499 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:50.499 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:50.508 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:50.592 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:50.590+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:50.652 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:50.652 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:50.660 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:50.701 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:50.699+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:50.763 INFO:tasks.thrashosds.thrasher:Moving pg 2.4 from osd.1 to osd.2 2024-09-17T23:03:50.763 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-2 --journal-path /var/lib/ceph/osd/ceph-2/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.2.4.1 2024-09-17T23:03:50.784 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:50.782+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:50.803 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:50.803 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:50.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:50.885 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:50.883+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:50.955 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:50.955 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:50.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:50.986 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:50.984+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:51.065 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:51.066 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:51.074 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:51.088 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:51.085+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:51.177 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:51.189 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:51.190 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:51.187+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:51.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:51.290 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:51.287+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:51.303 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:51.303 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:51.303 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:51.304 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:03:51.321 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:51.321 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:51.339 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:51.339 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:51.349 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:51.349 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:51.349 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:51.349 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:51.349 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:51.356 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:51.356 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:51.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:51.373 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:51.374 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:51.378 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:51.378 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:51.419 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:51.417+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:51.472 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:51.472 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:51.472 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:51.472 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.048234261999994, 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:51.473 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:51.474 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:51.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:51.476 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:51.477 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.047787349999993, 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:51.479 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.480 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.481 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.031108708999994, 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.482 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.483 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:51.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:51.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.030555039000006, 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.029943415000005, 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.491 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:51.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.029290716000006, 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.496 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.497 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.498 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.028754575999997, 2024-09-17T23:03:51.500 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:51.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:51.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.504 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.013951379000005, 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.506 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.507 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.013608696000006, 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.510 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.511 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:51.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.514 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.013039311, 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.515 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.516 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:51.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:51.518 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.010559127999997, 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:51.520 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.521 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:51.522 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:51.523 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.524 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.003055661999994, 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.525 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:51.526 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:51.527 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.528 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:51.529 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.002554216999997, 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.530 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:51.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:51.532 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:51.533 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.534 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 89.999918496000006, 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.535 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:51.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:51.537 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 89.992060824999996, 2024-09-17T23:03:51.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:51.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:51.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.542 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:51.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:51.544 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 89.853955001000003, 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.546 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.547 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.548 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 89.443138215000005, 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.549 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:51.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.553 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 88.939304722000003, 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:51.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:51.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.556 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.556 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:51.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:51.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.558 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 88.933903602000001, 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:51.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:51.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:51.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 13.506204754000001, 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:51.563 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:51.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:03:51.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:51.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:51.568 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:51.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:51.570 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:51.567+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:51.671 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:51.668+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:51.719 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:51.720 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:51.720 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:51.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:51.771 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:51.769+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:51.835 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:51.835 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:51.835 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:51.835 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:51.835 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:51.843 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:51.872 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:51.870+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:51.950 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:51.950 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:51.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:51.950 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:51.950 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:51.959 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:51.973 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:51.971+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:52.068 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:52.068 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:52.068 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:52.068 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:52.074 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:52.072+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:52.077 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:52.175 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:52.172+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:52.180 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:52.180 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:52.181 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:52.181 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:52.189 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:52.276 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:52.274+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:52.334 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:52.334 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:52.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:52.335 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:52.335 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:52.343 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:52.377 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:52.374+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:52.444 INFO:teuthology.orchestra.run.smithi005.stdout:get_pg_num_history pg_num_history pg_num_history(e49 pg_nums {1={15=1},2={18=8}} deleted_pools ) 2024-09-17T23:03:52.445 INFO:teuthology.orchestra.run.smithi005.stdout:Importing pgid 2.4 2024-09-17T23:03:52.445 INFO:teuthology.orchestra.run.smithi005.stdout:write_pg epoch 21 info 2.4( empty local-lis/les=18/19 n=0 ec=18/18 lis/c=18/18 les/c/f=19/19/0 sis=18) 2024-09-17T23:03:52.446 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:52.447 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:52.447 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:52.447 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:52.448 INFO:teuthology.orchestra.run.smithi005.stdout:Import successful 2024-09-17T23:03:52.456 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:52.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:03:52.500 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:52.498+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:52.559 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:52.560 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:52.560 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:52.560 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:52.560 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:52.568 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:52.578 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:52.576+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:52.678 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:52.676+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:52.714 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 86.474520132999999, 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.715 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:52.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:52.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:52.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:52.723 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 85.473018170000003, 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:52.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:52.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:52.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:52.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:52.731 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.731 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.731 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.732 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:52.732 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:52.732 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.467143245000003, 2024-09-17T23:03:52.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:52.732 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.732 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.733 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.733 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.733 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:52.733 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:52.733 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:52.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.734 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:52.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.735 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.735 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:52.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.735 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:52.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:52.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:52.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:52.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:52.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:52.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:52.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:52.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.748920353000001, 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.742 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:03:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:03:52.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:03:52.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.747 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.747 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:03:52.747 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:03:52.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.748 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.748 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.748 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.748 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:52.748 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.745792676000001, 2024-09-17T23:03:52.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:03:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.750 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:52.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.743943647, 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.756 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:03:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:03:52.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:03:52.761 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.761 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.742629567, 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:52.762 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:03:52.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:52.767 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.741057034000001, 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:03:52.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:03:52.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:03:52.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.773 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.695154812, 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.774 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:52.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:03:52.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:10 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.779 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.693835994000001, 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028104099999999999, 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 10 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.780 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:52.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4300000000000003e-07 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017140+0000", 2024-09-17T23:03:52.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.85e-06 2024-09-17T23:03:52.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017147+0000", 2024-09-17T23:03:52.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.421e-06 2024-09-17T23:03:52.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017150+0000", 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.675e-06 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017195+0000", 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5126000000000001e-05 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017276+0000", 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0903999999999997e-05 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017412+0000", 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013542200000000001 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.555041551, 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027978299999999997, 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.786 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155925+0000", 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155926+0000", 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6000000000000003e-07 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155929+0000", 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9210000000000001e-06 2024-09-17T23:03:52.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155935+0000", 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9649999999999996e-06 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155938+0000", 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3249999999999999e-06 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.155970+0000", 2024-09-17T23:03:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2051999999999997e-05 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.156017+0000", 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6740000000000003e-05 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.156205+0000", 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018812000000000001 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.504158706, 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:52.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.795 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.502265881, 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:03:52.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:03:52.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.801 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.500771942, 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:03:52.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:03:52.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:03:52.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:03:52.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:03:52.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:52.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:03:52.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:03:52.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:03:52.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:03:52.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:52.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:03:52.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:03:52.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.498843217999999, 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.814 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.496945118999999, 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:52.820 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:52.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:03:52.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.496182719, 2024-09-17T23:03:52.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:03:52.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:03:52.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 9.5108165380000003, 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.830 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:03:52.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:03:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:03:52.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.836 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:03:52.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 9.5106897240000006, 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.839 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:03:52.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:03:52.844 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5098905040000004, 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:52.845 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:52.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:52.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:03:52.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:52.849 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:52.850 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:52.851 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:52.851 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:52.849+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:52.951 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:52.949+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:52.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /var/log/ceph/exp.2.4.1 2024-09-17T23:03:52.994 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:52.995 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:52.995 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:52.995 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:53.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:53.088 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:53.086+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:53.148 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:53.148 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:53.148 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:53.148 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:53.149 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:53.153 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:53.151+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:53.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:53.254 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:53.252+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:53.301 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.340526424, 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.302 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:03:53.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.335329945, 2024-09-17T23:03:53.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:03:53.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:03:53.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.332518817, 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:53.312 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:03:53.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:03:53.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:53.316 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.288886506000001, 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:03:53.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:03:53.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:53.321 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.288545385999999, 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:53.326 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.281145293, 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.327 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:03:53.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.145930572999999, 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:53.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:03:53.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.335 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.145629324, 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.336 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:03:53.337 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:03:53.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.095220525, 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:03:53.340 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:03:53.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:03:53.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:53.345 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.094903852, 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:53.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:03:53.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:03:53.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.350 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.087863434999999, 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:03:53.354 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.087587067999999, 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:53.355 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:03:53.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.084303831, 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:03:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:03:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:03:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:03:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:53.364 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:53.366 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:53.366 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:53.363+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:53.379 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:53.451 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:03:53.467 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:53.464+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:53.484 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:53.484 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:53.484 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:53.493 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:53.540 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:53.541 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:03:53.560 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:53.560 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:53.566 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:53.564+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:53.579 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:53.579 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:53.613 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:53.613 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:53.635 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:53.636 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:53.639 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:53.639 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:53.658 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:53.658 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:53.667 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:53.667 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:53.665+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:53.768 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:53.766+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:53.816 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:53.816 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:53.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:53.868 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:53.866+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:53.968 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:53.966+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:53.973 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:53.973 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:53.982 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:54.069 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:54.067+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:54.129 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:54.129 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:54.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:54.169 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:54.167+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:54.244 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:54.244 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:54.253 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:54.270 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:54.268+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:54.363 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:54.363 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:54.370 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:54.368+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:54.372 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:54.471 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:54.469+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:54.517 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:54.517 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:54.525 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:54.609 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:54.607+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:54.669 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:54.670 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:54.673 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:54.671+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:54.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:54.774 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:54.772+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:54.822 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:54.822 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:54.831 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:54.877 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:54.875+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:54.934 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:54.934 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:54.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:54.988 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:54.986+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:55.045 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:55.046 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:55.054 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:55.082 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:55.080+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:55.183 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:55.181+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:55.197 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:55.197 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:55.206 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:55.283 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:55.281+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:55.307 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:55.308 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:55.316 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:55.384 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:55.382+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:55.418 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:55.419 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:55.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:55.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:03:55.515 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:55.513+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:55.549 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:55.550 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:55.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:55.586 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:55.584+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:55.640 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:03:55.687 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:55.685+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:55.707 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:55.707 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:55.717 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:55.768 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:55.769 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:55.769 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:55.769 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:03:55.787 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:55.787 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:55.788 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:55.785+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:55.805 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:55.806 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:55.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:55.823 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:55.841 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:55.841 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:55.844 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:55.845 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:55.867 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:55.867 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:55.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:55.867 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:03:55.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.867 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:03:55.867 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:55.867 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.443585627000004, 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:03:55.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:03:55.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:03:55.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:55.872 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.443138715000003, 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:03:55.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:03:55.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.426460074000005, 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:03:55.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.881 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.425906404000003, 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:03:55.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:03:55.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.425294780000002, 2024-09-17T23:03:55.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:03:55.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.424642081000002, 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:03:55.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:03:55.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:03:55.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:03:55.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:03:55.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.424105940999993, 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:03:55.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:03:55.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.409302744000001, 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:03:55.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:55.908 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.408960061000002, 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:03:55.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:03:55.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.408390675999996, 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.913 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:03:55.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.917 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.405910492999993, 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:03:55.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:03:55.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.398407027000005, 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.923 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:03:55.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:03:55.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.397905582000007, 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.928 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:03:55.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:03:55.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.395269861000003, 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:03:55.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:03:55.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.387412190000006, 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:03:55.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:03:55.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.249306365999999, 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:55.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.946 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:03:55.947 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 93.838489580000001, 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:03:55.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:55.952 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 93.334656086999999, 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:03:55.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:03:55.957 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 93.329254966999997, 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:03:55.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.960 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.960 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:03:55.960 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:03:55.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.962 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 17.901556118999999, 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:03:55.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:03:55.964 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:03:55.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:03:55.966 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:03:55.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.968 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:55.969 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:55.969 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:55.970 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:55.971 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:55.968+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:56.070 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:56.068+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:56.118 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:56.118 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:56.118 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:56.119 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:56.127 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:56.171 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:56.169+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:56.234 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:56.234 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:56.234 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:03:56.234 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:03:56.234 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:56.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:56.272 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:56.270+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:56.373 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:56.371+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:56.389 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:56.389 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:03:56.389 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:03:56.389 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:03:56.389 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:56.397 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:56.467 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:03:56.474 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:56.471+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:56.515 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:56.515 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:56.515 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:56.515 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:56.525 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:56.575 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:56.573+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:56.669 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:56.670 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:56.670 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:56.670 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:56.670 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:56.676 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:56.674+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:56.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:56.777 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:56.775+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:56.781 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:56.782 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:03:56.782 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:56.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:56.878 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:56.876+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:56.934 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:56.935 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:56.935 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:56.935 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:56.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:56.984 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:56.982+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:57.079 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:57.077+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:57.087 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:57.087 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:57.087 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:57.087 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:57.087 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:57.096 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:57.180 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:57.178+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:57.240 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:57.240 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 91.001059837, 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:57.241 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:03:57.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:03:57.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:57.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:57.247 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.999557874000004, 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:03:57.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:03:57.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:03:57.254 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 88.993682949000004, 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:03:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:03:57.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.261 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.275460057, 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.262 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:03:57.265 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.272332380000002, 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:57.266 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:03:57.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:03:57.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:57.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.270483350999999, 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.272 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:03:57.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:03:57.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:03:57.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.269169270999999, 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:03:57.277 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:03:57.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:03:57.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:03:57.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.267596738000002, 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.285 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:03:57.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:03:57.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.221694515999999, 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.291 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:03:57.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:10 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.220375698000002, 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028104099999999999, 2024-09-17T23:03:57.295 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 10 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4300000000000003e-07 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017140+0000", 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.85e-06 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017147+0000", 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.421e-06 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017150+0000", 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.675e-06 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017195+0000", 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5126000000000001e-05 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017276+0000", 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0903999999999997e-05 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.299 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017412+0000", 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013542200000000001 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.030698409999999, 2024-09-17T23:03:57.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:03:57.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.028805585000001, 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.305 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.310 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.027311646000001, 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.311 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:03:57.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.025382921999999, 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.317 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:03:57.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:03:57.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:03:57.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.023484823, 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.322 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.326 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.022722423000001, 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:03:57.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:03:57.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.037356242, 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.332 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:03:57.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.335 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.336 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 14.037229428, 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.337 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.342 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 9.0364302080000005, 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:03:57.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:03:57.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.347 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.0354485029999996, 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.348 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:03:57.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.352 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.353 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:57.354 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:57.354 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:57.352+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:57.455 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:57.453+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:57.499 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:57.499 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:57.499 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:03:57.499 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:57.508 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:57.556 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:57.554+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:57.652 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:57.652 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:03:57.652 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:03:57.652 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:03:57.653 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:57.657 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:57.655+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:57.661 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:57.758 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:57.755+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:57.763 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:03:57.763 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:03:57.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:03:57.763 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.8022648, 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:57.764 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:03:57.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.797068321000001, 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.768 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:03:57.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.773 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.794257193, 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:57.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:03:57.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:03:57.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.750624882, 2024-09-17T23:03:57.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:57.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:03:57.781 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.750283761999999, 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:57.782 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:03:57.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.742883669000001, 2024-09-17T23:03:57.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:03:57.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:03:57.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.607668949000001, 2024-09-17T23:03:57.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.791 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:03:57.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.607367700000001, 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.795 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:03:57.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:03:57.799 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.556958901000002, 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.800 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:03:57.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:03:57.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.556642228000001, 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:03:57.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:03:57.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.549601810999999, 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:03:57.809 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:57.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:03:57.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.813 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.549325444000001, 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.814 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:03:57.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:03:57.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 19.546042206999999, 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:03:57.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:03:57.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.823 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:03:57.823 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:03:57.823 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:03:57.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:57.846 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:03:57.868 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:57.866+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:57.946 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:57.946 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:03:57.946 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:03:57.946 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:57.956 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:03:57.959 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:57.957+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:03:58.000 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:03:58.000 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:03:58.001 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:03:58.001 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:03:58.018 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:03:58.018 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:03:58.028 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:03:58.028 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:03:58.029 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T23:03:58.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T23:03:58.035 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:03:58.035 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:03:58.052 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:03:58.052 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:03:58.059 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:58.057+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:58.066 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:58.066 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:58.069 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:03:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:03:58.070 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:03:58.074 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:03:58.074 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:03:58.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:03:58.162 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:58.160+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:58.226 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:58.226 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:58.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:03:58.276 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:58.274+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:58.324 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:03:58.409 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:03:58.409 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 56, 2024-09-17T23:03:58.409 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "4cb0491c-5273-43ce-9711-0f68bec58f2e", 2024-09-17T23:03:58.409 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-09-17T23:02:05.418126+0000", 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-09-17T23:03:56.458315+0000", 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "last_up_change": "2024-09-17T23:03:42.411787+0000", 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "last_in_change": "2024-09-17T23:03:01.271643+0000", 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_num": 5799936, 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_set": [ 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "pglog_hardlimit", 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "purged_snapdirs", 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_deletes", 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "sortbitwise" 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_version": 4, 2024-09-17T23:03:58.410 INFO:teuthology.orchestra.run.smithi005.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_snapshot": "", 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_max": 2, 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd": 8, 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "require_min_compat_client": "luminous", 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "min_compat_client": "luminous", 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "require_osd_release": "squid", 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_crimson": false, 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": [ 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 1, 2024-09-17T23:03:58.411 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": ".mgr", 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:19.615759+0000", 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool", 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:03:58.412 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 1, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 1, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 1, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 1, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 1, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:03:58.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "17", 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 0, 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 0, 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:03:58.414 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:03:58.415 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:03:58.416 INFO:teuthology.orchestra.run.smithi005.stdout: "options": { 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_max": 32, 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_min": 1 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": {} 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 7.690000057220459, 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 7.690000057220459, 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 1, 2024-09-17T23:03:58.417 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 1, 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 1, 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 1, 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 1 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 2, 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": "rbd", 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:24.412869+0000", 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 8193, 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:03:58.418 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 8, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 8, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 8, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 8, 2024-09-17T23:03:58.419 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 8, 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "21", 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:03:58.420 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 2, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 21, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:03:58.421 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:03:58.422 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "options": {}, 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd": {} 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable", 2024-09-17T23:03:58.423 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 0, 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 0 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "69fa22ee-5c14-4f80-82fe-b22939183e4a", 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:58.424 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.425 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6802", 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6803", 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6806", 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6807", 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6804", 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:58.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6805", 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6801/3261733059", 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6803/3261733059", 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6807/3261733059", 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6805/3261733059", 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:58.429 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "a50256db-895f-4a6b-b83e-e251a3b53e10", 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:58.430 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 18, 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 22, 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6816", 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6817", 2024-09-17T23:03:58.431 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6818", 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.432 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6819", 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6822", 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.433 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6823", 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6820", 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.434 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6821", 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6817/3745424715", 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6819/3745424715", 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6823/3745424715", 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6821/3745424715", 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2", 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 36, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 50, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:58.436 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6824", 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6825", 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6826", 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6827", 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.438 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6830", 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6831", 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:58.439 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6828", 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6829", 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:03:58.440 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6825/3492189306", 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6827/3492189306", 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6831/3492189306", 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6829/3492189306", 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "b9664ac0-db52-42bb-aa10-9ad23cc7021a", 2024-09-17T23:03:58.441 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:58.442 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6808", 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6809", 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6810", 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6811", 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.444 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6814", 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6815", 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.445 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6812", 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6813", 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:03:58.446 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6809/1475101831", 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6811/1475101831", 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6815/1475101831", 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6813/1475101831", 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:03:58.447 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "5a11b2ff-7a67-40ed-8076-90ce187a3d96", 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 0, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6810", 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6811", 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6812", 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6813", 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:58.450 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6816", 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6817", 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:58.451 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6814", 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6815", 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.452 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6811/1406375140", 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6813/1406375140", 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6817/1406375140", 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6815/1406375140", 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "2361e4e6-f10b-417b-a976-a037ac890e11", 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:58.453 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6818", 2024-09-17T23:03:58.454 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6819", 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6820", 2024-09-17T23:03:58.455 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6821", 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6824", 2024-09-17T23:03:58.456 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6825", 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.457 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6822", 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6823", 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:03:58.458 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6819/2095030613", 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6821/2095030613", 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6825/2095030613", 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6823/2095030613", 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:03:58.459 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "8d3a457f-9981-4307-ac8e-4d45f1600ade", 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 39, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6802", 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6803", 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6804", 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6805", 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6808", 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6809", 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:58.463 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6806", 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6807", 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.464 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6803/3030792595", 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6805/3030792595", 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6809/3030792595", 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6807/3030792595", 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3", 2024-09-17T23:03:58.465 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 39, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.466 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6826", 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6827", 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.467 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6828", 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6829", 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6832", 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6833", 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6830", 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6831", 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6827/967279289", 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6829/967279289", 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6833/967279289", 2024-09-17T23:03:58.470 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6831/967279289", 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_xinfo": [ 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:58.471 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.899917+0000", 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.157860+0000", 2024-09-17T23:03:58.472 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 22 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.416164+0000", 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 50 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:03:58.473 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.907974+0000", 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:58.474 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.523463+0000", 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.326314+0000", 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:58.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.363775+0000", 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:03:58.476 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.492325+0000", 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 39 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap": [ 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.5", 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:03:58.477 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: 0 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_items": [], 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_primaries": [], 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_temp": [], 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_temp": [], 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklist": {}, 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "range_blocklist": {}, 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profiles": { 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "default": { 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-failure-domain": "osd", 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "k": "2", 2024-09-17T23:03:58.478 INFO:teuthology.orchestra.run.smithi005.stdout: "m": "1", 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin": "jerasure", 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "technique": "reed_sol_van" 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps_queue": [], 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "new_removed_snaps": [], 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "new_purged_snaps": [], 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_node_flags": {}, 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "device_class_flags": {}, 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": { 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_enabled": false, 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_bucket_count": 0, 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "degraded_stretch_mode": 0, 2024-09-17T23:03:58.479 INFO:teuthology.orchestra.run.smithi005.stdout: "recovering_stretch_mode": 0, 2024-09-17T23:03:58.480 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_bucket": 0 2024-09-17T23:03:58.480 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:03:58.480 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:03:58.480 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:03:58.481 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:58.479+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:58.482 INFO:tasks.thrashosds.thrasher:j is {'epoch': 56, 'fsid': '4cb0491c-5273-43ce-9711-0f68bec58f2e', 'created': '2024-09-17T23:02:05.418126+0000', 'modified': '2024-09-17T23:03:56.458315+0000', 'last_up_change': '2024-09-17T23:03:42.411787+0000', 'last_in_change': '2024-09-17T23:03:01.271643+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T23:02:19.615759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T23:02:24.412869+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '69fa22ee-5c14-4f80-82fe-b22939183e4a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6800', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6801', 'nonce': 3261733059}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6802', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6803', 'nonce': 3261733059}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6806', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6807', 'nonce': 3261733059}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6804', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6805', 'nonce': 3261733059}]}, 'public_addr': '172.21.15.5:6801/3261733059', 'cluster_addr': '172.21.15.5:6803/3261733059', 'heartbeat_back_addr': '172.21.15.5:6807/3261733059', 'heartbeat_front_addr': '172.21.15.5:6805/3261733059', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a50256db-895f-4a6b-b83e-e251a3b53e10', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 22, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6816', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6817', 'nonce': 3745424715}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6818', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6819', 'nonce': 3745424715}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6822', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6823', 'nonce': 3745424715}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6820', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6821', 'nonce': 3745424715}]}, 'public_addr': '172.21.15.5:6817/3745424715', 'cluster_addr': '172.21.15.5:6819/3745424715', 'heartbeat_back_addr': '172.21.15.5:6823/3745424715', 'heartbeat_front_addr': '172.21.15.5:6821/3745424715', 'state': ['exists']}, {'osd': 2, 'uuid': 'c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 36, 'down_at': 50, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6824', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6825', 'nonce': 3492189306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6826', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6827', 'nonce': 3492189306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6830', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6831', 'nonce': 3492189306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6828', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6829', 'nonce': 3492189306}]}, 'public_addr': '172.21.15.5:6825/3492189306', 'cluster_addr': '172.21.15.5:6827/3492189306', 'heartbeat_back_addr': '172.21.15.5:6831/3492189306', 'heartbeat_front_addr': '172.21.15.5:6829/3492189306', 'state': ['exists']}, {'osd': 3, 'uuid': 'b9664ac0-db52-42bb-aa10-9ad23cc7021a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6808', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6809', 'nonce': 1475101831}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6810', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6811', 'nonce': 1475101831}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6814', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6815', 'nonce': 1475101831}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6812', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6813', 'nonce': 1475101831}]}, 'public_addr': '172.21.15.5:6809/1475101831', 'cluster_addr': '172.21.15.5:6811/1475101831', 'heartbeat_back_addr': '172.21.15.5:6815/1475101831', 'heartbeat_front_addr': '172.21.15.5:6813/1475101831', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5a11b2ff-7a67-40ed-8076-90ce187a3d96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6810', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6811', 'nonce': 1406375140}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6812', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6813', 'nonce': 1406375140}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6816', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6817', 'nonce': 1406375140}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6814', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6815', 'nonce': 1406375140}]}, 'public_addr': '172.21.15.152:6811/1406375140', 'cluster_addr': '172.21.15.152:6813/1406375140', 'heartbeat_back_addr': '172.21.15.152:6817/1406375140', 'heartbeat_front_addr': '172.21.15.152:6815/1406375140', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2361e4e6-f10b-417b-a976-a037ac890e11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6818', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6819', 'nonce': 2095030613}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6820', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6821', 'nonce': 2095030613}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6824', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6825', 'nonce': 2095030613}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6822', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6823', 'nonce': 2095030613}]}, 'public_addr': '172.21.15.152:6819/2095030613', 'cluster_addr': '172.21.15.152:6821/2095030613', 'heartbeat_back_addr': '172.21.15.152:6825/2095030613', 'heartbeat_front_addr': '172.21.15.152:6823/2095030613', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8d3a457f-9981-4307-ac8e-4d45f1600ade', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6802', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6803', 'nonce': 3030792595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6804', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6805', 'nonce': 3030792595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6808', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6809', 'nonce': 3030792595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6806', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6807', 'nonce': 3030792595}]}, 'public_addr': '172.21.15.152:6803/3030792595', 'cluster_addr': '172.21.15.152:6805/3030792595', 'heartbeat_back_addr': '172.21.15.152:6809/3030792595', 'heartbeat_front_addr': '172.21.15.152:6807/3030792595', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 39, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6826', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6827', 'nonce': 967279289}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6828', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6829', 'nonce': 967279289}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 967279289}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6830', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6831', 'nonce': 967279289}]}, 'public_addr': '172.21.15.152:6827/967279289', 'cluster_addr': '172.21.15.152:6829/967279289', 'heartbeat_back_addr': '172.21.15.152:6833/967279289', 'heartbeat_front_addr': '172.21.15.152:6831/967279289', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.899917+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.157860+0000', 'dead_epoch': 22}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.416164+0000', 'dead_epoch': 50}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.907974+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.523463+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.326314+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.363775+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.492325+0000', 'dead_epoch': 39}], 'pg_upmap': [{'pgid': '2.5', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T23:03:58.483 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:03:58.483 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:58.484 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:58.484 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:03:58.582 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:58.580+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:58.635 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:58.635 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:58.647 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:03:58.688 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:58.686+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:58.784 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:58.782+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:58.795 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:58.795 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:58.804 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:03:58.819 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:03:58.819 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:03:58.831 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-17T23:03:57.586893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590403,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":227,"num_read_kb":191,"num_write":176,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":9,"acting":9,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":238204,"kb_used_data":5340,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736516,"statfs":{"total":773094113280,"available":772850192384,"internally_reserved":0,"allocated":5468160,"data_stored":2891138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.141930"},"pg_stats":[{"pgid":"2.7","version":"47'1","reported_seq":88,"reported_epoch":54,"state":"active+undersized","last_fresh":"2024-09-17T23:03:50.722764+0000","last_change":"2024-09-17T23:03:15.332009+0000","last_active":"2024-09-17T23:03:50.722764+0000","last_peered":"2024-09-17T23:03:50.722764+0000","last_clean":"2024-09-17T23:03:11.324896+0000","last_became_active":"2024-09-17T23:03:15.332009+0000","last_became_peered":"2024-09-17T23:03:15.332009+0000","last_unstale":"2024-09-17T23:03:50.722764+0000","last_undegraded":"2024-09-17T23:03:50.722764+0000","last_fullsized":"2024-09-17T23:03:15.331460+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:09:02.516092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"47'1","reported_seq":77,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:03:50.722764+0000","last_change":"2024-09-17T23:03:38.010425+0000","last_active":"2024-09-17T23:03:50.722764+0000","last_peered":"2024-09-17T23:03:50.722764+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.206501+0000","last_became_peered":"2024-09-17T23:02:36.206501+0000","last_unstale":"2024-09-17T23:03:50.722764+0000","last_undegraded":"2024-09-17T23:03:37.965028+0000","last_fullsized":"2024-09-17T23:02:36.205957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:14:38.209826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":1}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-17T23:03:53.448077+0000","last_change":"2024-09-17T23:03:43.419919+0000","last_active":"2024-09-17T23:03:53.448077+0000","last_peered":"2024-09-17T23:03:53.448077+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:03:43.419919+0000","last_became_peered":"2024-09-17T23:03:43.419919+0000","last_unstale":"2024-09-17T23:03:53.448077+0000","last_undegraded":"2024-09-17T23:03:53.448077+0000","last_fullsized":"2024-09-17T23:03:43.419336+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:10.447292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"47'2","reported_seq":74,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:03:53.448302+0000","last_change":"2024-09-17T23:03:38.216030+0000","last_active":"2024-09-17T23:03:53.448302+0000","last_peered":"2024-09-17T23:03:53.448302+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.205932+0000","last_became_peered":"2024-09-17T23:02:36.205932+0000","last_unstale":"2024-09-17T23:03:53.448302+0000","last_undegraded":"2024-09-17T23:03:37.963691+0000","last_fullsized":"2024-09-17T23:02:36.205433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:27.219119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"47'7","reported_seq":110,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:03:51.275267+0000","last_change":"2024-09-17T23:02:36.206690+0000","last_active":"2024-09-17T23:03:51.275267+0000","last_peered":"2024-09-17T23:03:51.275267+0000","last_clean":"2024-09-17T23:02:28.601103+0000","last_became_active":"2024-09-17T23:02:36.206690+0000","last_became_peered":"2024-09-17T23:02:36.206690+0000","last_unstale":"2024-09-17T23:03:51.275267+0000","last_undegraded":"2024-09-17T23:02:36.206032+0000","last_fullsized":"2024-09-17T23:02:36.205941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:18.666349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+undersized","last_fresh":"2024-09-17T23:03:53.448005+0000","last_change":"2024-09-17T23:03:43.419931+0000","last_active":"2024-09-17T23:03:53.448005+0000","last_peered":"2024-09-17T23:03:53.448005+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:03:43.419931+0000","last_became_peered":"2024-09-17T23:03:43.419931+0000","last_unstale":"2024-09-17T23:03:53.448005+0000","last_undegraded":"2024-09-17T23:03:53.448005+0000","last_fullsized":"2024-09-17T23:03:43.419324+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:37.122490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"stale+active+undersized","last_fresh":"2024-09-17T23:03:08.303154+0000","last_change":"2024-09-17T23:02:36.204438+0000","last_active":"2024-09-17T23:03:08.303154+0000","last_peered":"2024-09-17T23:03:08.303154+0000","last_clean":"2024-09-17T23:02:28.597949+0000","last_became_active":"2024-09-17T23:02:36.204438+0000","last_became_peered":"2024-09-17T23:02:36.204438+0000","last_unstale":"2024-09-17T23:03:14.328698+0000","last_undegraded":"2024-09-17T23:03:08.303154+0000","last_fullsized":"2024-09-17T23:02:36.203989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:29:19.022828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"51'6","reported_seq":123,"reported_epoch":54,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:03:51.275345+0000","last_change":"2024-09-17T23:03:43.423198+0000","last_active":"2024-09-17T23:03:51.275345+0000","last_peered":"2024-09-17T23:03:51.275345+0000","last_clean":"2024-09-17T23:03:42.574324+0000","last_became_active":"2024-09-17T23:03:43.423198+0000","last_became_peered":"2024-09-17T23:03:43.423198+0000","last_unstale":"2024-09-17T23:03:51.275345+0000","last_undegraded":"2024-09-17T23:03:43.422693+0000","last_fullsized":"2024-09-17T23:03:43.422600+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:45:54.029051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":55,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:03:53.448039+0000","last_change":"2024-09-17T23:03:15.332337+0000","last_active":"2024-09-17T23:03:53.448039+0000","last_peered":"2024-09-17T23:03:53.448039+0000","last_clean":"2024-09-17T23:02:22.544336+0000","last_became_active":"2024-09-17T23:03:15.332337+0000","last_became_peered":"2024-09-17T23:03:15.332337+0000","last_unstale":"2024-09-17T23:03:53.448039+0000","last_undegraded":"2024-09-17T23:03:15.331270+0000","last_fullsized":"2024-09-17T23:03:15.331175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:02:33.805222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":91,"num_write":17,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":8,"acting":8,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":745489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":626688,"data_stored":253329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":626688,"data_stored":253332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27636,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":622592,"data_stored":253313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":622592,"data_stored":253313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":215095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1216512,"data_stored":843681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:03:58.832 INFO:tasks.thrashosds.thrasher:Setting 2.7 to [7, 4] 2024-09-17T23:03:58.832 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.7', '7', '4'] 2024-09-17T23:03:58.832 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.7 7 4 2024-09-17T23:03:58.915 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:58.915 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:58.916 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:58.914+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:58.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:03:58.986 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:58.983+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:59.027 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:59.027 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:59.036 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:03:59.086 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:59.084+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:59.139 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:59.139 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:59.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:03:59.187 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:03:59.185+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:03:59.251 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:59.251 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:59.260 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:03:59.288 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:59.286+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:59.362 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:59.362 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:59.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:03:59.389 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:03:59.387+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:03:59.473 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:59.474 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:59.477 INFO:teuthology.orchestra.run.smithi005.stderr:set 2.7 pg_upmap mapping to [7,4] 2024-09-17T23:03:59.478 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:03:59.483 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:03:59.527 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:59.525+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:59.586 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:59.586 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:59.590 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:59.588+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:59.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:03:59.691 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:03:59.689+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:03:59.739 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:59.739 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:59.748 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:03:59.832 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:59.830+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:59.892 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:03:59.892 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:03:59.893 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:03:59.890+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:03:59.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:03:59.994 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:03:59.992+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:00.021 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:00.021 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:00.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:00.075 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:00.119 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:00.117+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:00.138 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:00.139 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:00.148 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:00.196 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:00.193+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:00.199 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:00.200 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:00.219 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:00.220 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:00.236 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:00.237 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:00.253 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:00.254 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:00.270 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:00.271 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:00.271 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:00.274 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:00.275 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:00.296 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:00.294+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:00.299 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:00.299 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:00.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.876068977000003, 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.300 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.301 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:00.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:00.304 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.875622065000002, 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:00.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:00.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:00.309 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.858943424000003, 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:00.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:00.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:00.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.858389754000001, 2024-09-17T23:04:00.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:00.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:00.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.85777813, 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.319 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:00.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.857125431, 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:00.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.856589291000006, 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:00.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.333 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.841786094, 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:00.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.337 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.841443411, 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:00.338 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:00.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.840874025999995, 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.343 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:00.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:00.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.347 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.838393843000006, 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.352 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.830890377000003, 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:00.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:00.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:00.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.830388932000005, 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.357 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:00.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.361 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.827753211000001, 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:00.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.365 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.819895540000005, 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.366 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:00.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:00.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:00.370 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.681789715999997, 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.371 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.375 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.270972929999999, 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.376 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:00.377 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:00.378 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.379 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 97.767139436999997, 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.380 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:00.381 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:00.382 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:00.383 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:00.384 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 97.761738316999995, 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:00.385 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.386 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.386 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.386 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.386 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:00.386 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.387 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:00.388 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:00.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 22.334039469, 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:00.390 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:00.391 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:00.391 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:00.391 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:00.391 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:00.391 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:00.391 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:00.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.391 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:00.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.392 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:00.392 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:00.392 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.393 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:00.393 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:00.393 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:00.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.394 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:00.394 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:00.394 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:00.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.394 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:00.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:00.396 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.397 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:00.398 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:00.398 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:00.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:00.399 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:00.397+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:00.500 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:00.498+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:00.548 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:00.548 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:00.548 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:00.548 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:00.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:00.600 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:00.598+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:00.701 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:00.699+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:00.704 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:00.704 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:00.704 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:00.704 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:00.704 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:00.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:00.802 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:00.799+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:00.819 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:00.819 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:00.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:00.819 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:04:00.820 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:00.828 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:00.903 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:00.901+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:00.937 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:00.937 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:00.937 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:00.938 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:00.946 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:01.004 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:01.002+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:01.089 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:01.089 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:01.089 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:01.090 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:01.090 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:01.098 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:01.141 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:01.139+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:01.202 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:01.202 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:01.202 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:01.202 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:01.202 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:01.205 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:01.203+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:01.211 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:01.306 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:01.304+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:01.355 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:01.355 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:01.355 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:01.355 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:01.363 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:01.407 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:01.405+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:01.467 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:01.467 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:01.467 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:01.467 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:01.467 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:01.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:01.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:04:01.540 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:01.538+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:01.609 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:01.606+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:01.621 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:01.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 95.381455475999999, 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.622 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:01.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:01.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:01.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.628 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 94.379953513000004, 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.629 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:01.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:01.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.374078588000003, 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.636 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:01.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:01.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:01.643 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.655855696, 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:01.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:01.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:01.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.652728019000001, 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:01.648 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:01.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:01.654 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.650878989999999, 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.655 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.649564909999999, 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:01.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:01.664 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.647992377000001, 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.665 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:01.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.670 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.602090154999999, 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:04:01.674 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.675 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.675 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.675 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:10 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.675 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:01.675 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.600771337000001, 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028104099999999999, 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 10 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:01.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4300000000000003e-07 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017140+0000", 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.85e-06 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017147+0000", 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.421e-06 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017150+0000", 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.675e-06 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.678 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017195+0000", 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5126000000000001e-05 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017276+0000", 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0903999999999997e-05 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017412+0000", 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013542200000000001 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.679 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.411094048999999, 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.680 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.684 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.409201224, 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.685 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:01.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:01.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:01.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:01.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:01.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:01.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:01.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.691 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.407707285000001, 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.692 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:01.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.405778560999998, 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.698 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:01.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:01.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.403880462, 2024-09-17T23:04:01.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:01.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:01.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.708 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.403118062000001, 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:01.712 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 18.417751881000001, 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.713 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:01.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:01.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:01.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 18.417625066999999, 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.718 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:01.722 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 13.416825847, 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:04:01.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:04:01.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 8.4158441419999992, 2024-09-17T23:04:01.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:01.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:01.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:01.731 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.732 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.732 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.732 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:01.732 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:01.732 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:01.733 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:01.734 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:01.731+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:01.834 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:01.832+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:01.877 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:01.877 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:01.877 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:01.877 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:01.885 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:01.935 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:01.933+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:01.988 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:01.988 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:01.989 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:01.989 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:01.989 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:01.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:02.041 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:02.039+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:02.102 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:02.102 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:02.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:02.102 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.141257685999999, 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:02.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.106 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.136061207000001, 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:02.107 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:02.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:02.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.133250079, 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.112 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:02.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:02.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.089617768, 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:02.116 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:02.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.089276647999998, 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.121 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.081876555000001, 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.946661835, 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:02.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.134 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.946360586000001, 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:02.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:02.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.895951787000001, 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.139 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:02.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:02.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.895635114000001, 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:02.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:02.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.888594696999998, 2024-09-17T23:04:02.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:02.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:02.152 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.888318330000001, 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:02.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:02.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:02.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 23.885035092999999, 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:02.157 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:02.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:02.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:02.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:02.161 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:02.163 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:02.160+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:02.163 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:02.219 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:04:02.264 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:02.261+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:02.276 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:02.277 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:02.277 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:02.277 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:02.287 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:02.365 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:02.362+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:02.401 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:02.401 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:02.401 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:02.401 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:02.419 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:02.419 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:02.436 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:02.436 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:02.437 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:02.437 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:02.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:02.454 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:02.454 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:02.465 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:02.463+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:02.471 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:02.471 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:02.471 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:02.474 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:02.475 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:02.553 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:02.553 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:02.562 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:02.566 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:02.564+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:02.667 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:02.665+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:02.669 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:02.669 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:02.678 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:02.767 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:02.765+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:02.784 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:02.785 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:02.793 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:02.868 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:02.866+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:02.900 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:02.901 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:02.909 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:02.968 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:02.966+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:03.018 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:03.019 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:03.027 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:03.072 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:03.070+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:03.131 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:03.131 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:03.140 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:03.181 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:03.179+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:03.271 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:03.268+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:03.283 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:03.283 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:03.292 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:03.376 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:03.374+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:03.435 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:03.435 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:03.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:03.473 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:03.471+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:03.574 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:03.572+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:03.589 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:03.589 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:03.598 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:03.679 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:03.677+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:03.746 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:03.746 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:03.755 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:03.801 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:03.799+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:03.861 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:03.861 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:03.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:03.877 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:03.874+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:03.978 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:03.975+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:04.012 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:04.013 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:04.022 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:04.107 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:04.105+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:04.165 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:04.165 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:04.173 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:04.215 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:04.213+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:04.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:04:04.280 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:04.278+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:04.297 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:04.297 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:04.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:04.381 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:04.379+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:04.415 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:04.416 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:04.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:04.475 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:04.482 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:04.480+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:04.494 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:04.494 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:04.495 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-17T23:04:04.495 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T23:04:04.495 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T23:04:04.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-17T23:04:04.575 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:04.575 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:04.583 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:04.581+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:04.584 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:04.599 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:04.599 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T23:04:04.600 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:04.635 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:04.636 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:04.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:04.654 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:04.671 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:04.671 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:04.683 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:04.681+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:04.688 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:04.688 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:04.693 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:04.693 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:04.693 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:04.693 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:04.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:04.705 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:04.705 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:04.709 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:04.709 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:04.785 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:04.782+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:04.809 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:04.809 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:04.809 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:04.810 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:04.810 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:04.818 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:04.886 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:04.883+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:04.967 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:04.967 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:04.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:04.967 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:04:04.967 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:04.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:05.019 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:05.017+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:05.081 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:05.081 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:05.081 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:05.081 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:05.087 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:05.085+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:05.089 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:05.188 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:05.186+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:05.225 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:04:05.234 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:05.234 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:05.234 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:05.234 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:05.234 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:05.243 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:05.327 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:05.325+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:05.386 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:05.386 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:05.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:05.386 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:05.386 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:05.389 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:05.387+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:05.395 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:05.490 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:05.488+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:05.538 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:05.538 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:05.538 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:05.538 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:05.547 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:05.591 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:05.589+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:05.691 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:05.691 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:05.691 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:05.691 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:05.691 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:05.692 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:05.689+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:05.700 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:05.793 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:05.790+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:05.804 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:05.804 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 99.565125417999994, 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.805 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:05.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:05.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:05.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:05.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.563623454999998, 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.812 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:05.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:05.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.557748529999998, 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.819 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:05.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:05.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.839525638000001, 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:05.825 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.829 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.836397960999999, 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:05.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:05.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.835 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.834548932000001, 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.836 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:05.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:05.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.833234852, 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.841 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:05.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:05.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:05.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:05.847 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.831662318999999, 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:05.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.852 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.785760097000001, 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.853 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:10 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:05.857 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.784441278999999, 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028104099999999999, 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 10 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.858 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4300000000000003e-07 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017140+0000", 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.85e-06 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017147+0000", 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.421e-06 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017150+0000", 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.675e-06 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017195+0000", 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5126000000000001e-05 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017276+0000", 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0903999999999997e-05 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017412+0000", 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013542200000000001 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.861 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.594763991000001, 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:04:05.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.592871165999998, 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:05.866 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.867 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:05.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:05.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:05.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:05.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.591377226999999, 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:05.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.876 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:05.877 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.589448503, 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.878 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:05.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.587550404000002, 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:05.883 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.886 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.887 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 27.586788003999999, 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.889 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:05.890 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.891 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.892 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.601421822999999, 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:05.893 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.894 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.895 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:05.896 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:05.897 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.601295009000001, 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:05.898 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:05.900 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.901 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.902 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:04:05.903 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 17.600495789, 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.904 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.905 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:04:05.906 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:04:05.907 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 12.599514083999999, 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:05.908 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.909 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:05.910 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:05.911 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.912 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:05.913 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:05.913 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:05.914 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:05.914 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:05.912+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:06.015 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:06.013+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:06.057 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:06.057 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:06.057 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:06.065 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:06.149 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:06.147+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:06.208 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:06.208 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:06.208 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:06.208 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:06.208 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:06.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:06.217 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:06.214+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:06.317 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:06.315+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:06.361 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:06.361 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.400367458000002, 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:06.362 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:06.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.395170979, 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.366 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:06.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.371 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.392359850999998, 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.375 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.348727539999999, 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:06.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:06.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:06.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.348386420000001, 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:06.380 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:06.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.340986327, 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.385 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:06.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.388 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.205771606999999, 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:06.389 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.393 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.205470357999999, 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.394 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:06.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:06.397 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.155061559, 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:06.398 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.399 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.400 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:06.401 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.154744886, 2024-09-17T23:04:06.402 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:06.403 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.405 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.147704469000001, 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:06.407 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:06.408 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:06.409 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:06.410 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.147428101999999, 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:06.412 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.413 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:06.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:06.415 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 28.144144865000001, 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:06.416 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.417 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.418 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:06.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:06.420 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:06.422 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:06.419+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:06.422 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:06.522 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:06.520+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:06.542 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:06.542 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:06.542 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:06.542 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:06.551 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:06.623 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:06.621+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:06.659 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:06.659 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:06.659 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:06.659 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:06.659 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:06.668 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:06.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:06.725 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:06.722+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:06.777 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:06.777 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:06.777 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.353389994, 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:06.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:06.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:06.782 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.352943082, 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.783 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:06.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:06.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.336264441, 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:06.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:06.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.335710771, 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.793 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:06.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:06.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:06.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:06.798 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.33509914699999, 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:06.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.33444644799999, 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.803 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:06.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.807 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.333910308, 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.809 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.809 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:06.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:06.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.31910711099999, 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.814 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.31876442799999, 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:06.819 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.821 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.318195043, 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:06.824 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.825 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:06.826 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.31571486, 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.833 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:06.834 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.308211394, 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:06.835 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:06.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.837 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:06.838 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.839 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.307709949, 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.840 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.844 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.305074228, 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.846 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:06.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.848 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:06.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.850 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.297216557, 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.851 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.852 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.853 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:06.854 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:06.855 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.856 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 105.15911073300001, 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.857 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:06.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:06.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.861 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 104.74829394699999, 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.862 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:06.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:06.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.866 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.867 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 104.24446045400001, 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:06.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:06.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.872 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 104.239059334, 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:06.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:06.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:06.878 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 28.811360486000002, 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:06.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:06.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:06.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:06.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:06.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.884 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:06.884 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:06.884 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:06.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:06.886 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:06.887 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:06.887 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:06.888 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:06.888 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:06.888 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:06.883+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:06.889 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:06.889 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:06.904 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:06.904 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:06.908 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:06.908 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:06.987 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:06.984+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:06.996 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:06.996 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:07.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:07.088 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:07.085+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:07.111 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:07.111 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:07.120 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:07.188 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:07.186+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:07.227 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:07.227 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:07.236 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:07.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:04:07.289 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:07.287+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:07.351 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:07.351 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:07.360 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:07.389 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:07.387+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:07.491 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:07.488+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:07.504 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:07.505 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:07.514 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:07.592 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:07.590+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:07.618 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:07.618 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:07.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:07.693 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:07.691+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:07.729 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:07.729 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:07.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:07.824 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:07.822+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:07.884 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:07.884 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:07.892 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:07.933 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:07.931+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:07.996 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:07.994+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:08.034 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:08.034 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:08.043 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:08.097 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:08.095+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:08.146 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:08.147 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:08.156 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:08.198 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:08.196+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:08.239 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:04:08.298 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:08.296+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:08.302 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:08.302 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:08.311 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:08.399 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:08.397+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:08.455 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:08.456 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:08.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:08.509 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:08.507+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:08.585 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:08.585 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:08.595 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:08.636 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:08.634+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:08.702 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:08.700+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:08.743 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:08.743 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:08.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:08.803 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:08.801+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:08.858 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:08.858 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:08.867 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:08.904 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:08.902+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:08.909 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:09.005 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:09.003+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:09.018 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:09.018 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:09.028 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:09.034 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:09.035 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:09.052 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:09.053 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:09.070 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:09.070 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:09.087 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:09.087 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:09.104 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:09.105 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:09.105 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:09.106 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:09.104+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:09.109 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:09.109 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:09.142 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:09.142 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:09.142 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:09.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:09.207 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:09.205+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:09.300 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:09.300 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [] 2024-09-17T23:04:09.300 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:09.307 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:09.305+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:09.309 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:09.408 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:09.406+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:09.420 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:09.420 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:09.420 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:09.430 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:09.514 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:09.512+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:09.573 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:09.573 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:09.573 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:09.573 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:09.573 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:09.581 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:09.609 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:09.609 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:09.609 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2024-09-17T23:04:09.609 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T23:04:09.609 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T23:04:09.610 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2024-09-17T23:04:09.622 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:09.620+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:09.710 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:09.708+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:09.726 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:09.726 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T23:04:09.727 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:09.727 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:09.728 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:09.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:09.728 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:09.728 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:09.737 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:09.811 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:09.809+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:09.880 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:09.881 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:09.881 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:09.881 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:09.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:09.933 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:09.931+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:09.993 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:09.993 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:09.993 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:09.993 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:09.994 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:10.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:10.012 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:10.010+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:10.113 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:10.111+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:10.147 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 103.908185876, 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.148 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:10.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:10.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.90668391299999, 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:10.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.159 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 101.90080898799999, 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.161 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:10.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:10.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:10.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:10.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.167 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.182586096000001, 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.171 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.179458418999999, 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:10.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.177 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.177609390000001, 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.182 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.17629531, 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.183 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:10.187 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.174722776999999, 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:10.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:10.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.128820554999997, 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.193 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:10 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.197 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.127501737000003, 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028104099999999999, 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 10 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4300000000000003e-07 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017140+0000", 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.85e-06 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017147+0000", 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.421e-06 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017150+0000", 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.675e-06 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017195+0000", 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5126000000000001e-05 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017276+0000", 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0903999999999997e-05 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017412+0000", 2024-09-17T23:04:10.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013542200000000001 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.937824449000001, 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:04:10.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.935931623999998, 2024-09-17T23:04:10.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.934437684999999, 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.212 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:10.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:10.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:10.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:10.217 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.932508961, 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.218 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:10.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:10.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.930610862000002, 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.223 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:10.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:10.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.929848461999999, 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.228 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:10.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.232 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 26.944482280999999, 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:10.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:10.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 26.944355467000001, 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:10.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:10.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:10.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.943556247, 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:04:10.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:04:10.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 16.942574541999999, 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.247 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:10.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:10.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.251 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:10.253 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:10.253 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:10.250+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:10.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:04:10.354 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:10.351+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:10.397 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:10.397 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:10.397 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:10.397 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:10.406 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:10.490 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:10.488+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:10.549 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:10.549 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:10.549 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:10.550 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:10.550 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:10.555 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:10.553+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:10.558 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:10.656 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:10.654+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.740953544999996, 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.702 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:10.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:10.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:10.705 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.735757065999998, 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:10.706 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:10.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.732945938, 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.689313626999997, 2024-09-17T23:04:10.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.718 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.688972507000003, 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:10.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:10.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.722 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.681572414000001, 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:10.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.726 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.546357694000001, 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:10.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:10.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.730 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.546056444999998, 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:10.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.734 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.495647646000002, 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.735 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:10.738 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.495330973000002, 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:10.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:10.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:10.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:10.742 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.488290556000003, 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:10.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:10.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:10.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:10.746 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.488014188999998, 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:10.747 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:10.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:10.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 32.484730952, 2024-09-17T23:04:10.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:10.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:10.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:10.754 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:10.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:10.756 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:10.754+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:10.857 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:10.855+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:10.864 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:10.864 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:10.864 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:10.864 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:10.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:10.957 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:10.955+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:10.979 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:10.979 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:10.979 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:10.979 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:10.979 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:10.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:11.058 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:11.056+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:11.096 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:11.096 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:11.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:11.096 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:11.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.096 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:11.096 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.67263948199999, 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:11.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:11.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.67219256999999, 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.65551392899999, 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.108 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.65496025900001, 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:11.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:11.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:11.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.65434863500001, 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:11.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:11.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:11.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.116 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.65369593600001, 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:11.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:11.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:11.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:11.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.653159796, 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:11.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:11.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.63835659900001, 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.125 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:11.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:11.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.63801391600001, 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.129 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:11.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:11.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:11.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.637444531, 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.133 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:11.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:11.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.634964348, 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.137 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:11.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:11.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.62746088199999, 2024-09-17T23:04:11.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.626959437, 2024-09-17T23:04:11.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.62432371600001, 2024-09-17T23:04:11.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:11.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.616466045, 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:11.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.157 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.478360221, 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:11.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 109.067543435, 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.165 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 108.563709942, 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:11.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:11.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 108.558308822, 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:11.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:11.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 33.130609974000002, 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:11.174 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:11.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:11.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:11.178 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:11.179 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:11.180 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:11.180 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:11.178+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:11.240 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:04:11.298 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:11.296+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:11.333 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:11.333 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:11.333 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:11.342 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:11.348 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:11.349 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:11.366 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:11.367 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:11.382 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:11.380+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:11.383 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:11.384 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:11.401 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:11.401 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:11.418 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:11.418 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:11.422 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:11.422 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:11.455 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:11.456 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:11.464 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:11.483 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:11.480+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:11.583 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:11.581+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:11.611 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:11.612 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:11.620 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:11.684 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:11.682+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:11.727 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:11.727 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:11.736 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:11.820 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:11.818+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:11.879 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:11.879 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:11.886 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:11.884+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:11.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:11.987 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:11.985+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:12.031 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:12.031 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:12.040 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:12.124 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:12.122+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:12.183 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:12.188 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:12.186+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:12.192 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:12.289 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:12.287+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:12.335 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:12.335 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:12.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:12.390 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:12.388+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:12.487 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:12.487 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:12.491 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:12.488+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:12.496 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:12.591 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:12.589+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:12.641 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:12.641 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:12.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:12.733 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:12.731+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:12.792 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:12.792 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:12.792 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:12.790+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:12.800 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:12.893 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:12.891+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:12.943 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:12.943 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:12.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:12.994 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:12.992+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:13.071 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:13.071 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:13.080 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:13.095 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:13.093+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:13.188 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:13.188 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:13.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:13.197 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:13.194+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:13.258 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:04:13.297 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:13.294+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:13.304 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:13.304 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:13.314 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:13.398 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:13.395+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:13.423 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:13.424 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:13.424 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:13.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:13.499 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:13.497+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:13.548 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:13.549 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:13.549 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:13.549 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:13.569 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:04:13.567+0000 7ff43ffff640 0 --2- 172.21.15.5:0/2679228440 >> [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] conn(0x7ff4480b0800 0x7ff4481489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T23:04:13.582 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:13.582 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:13.600 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:13.597+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:13.600 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:13.600 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:13.600 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:13.600 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:13.600 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:13.606 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:13.606 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:13.610 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:13.623 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:13.623 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:13.641 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:13.641 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:13.641 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:13.644 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:13.645 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:13.700 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:13.698+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:13.718 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:13.718 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:13.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:13.718 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:13.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 4.1235699449999998, 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:13.719 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:13.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:13.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:13.722 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:13.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:13.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:13.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:13.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:13.723 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:13.727 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:13.801 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:13.799+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:13.833 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:13.834 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:13.834 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:13.834 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:13.841 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:13.901 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:13.899+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:13.944 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:13.944 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:13.944 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:13.944 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:13.944 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:13.953 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:14.002 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:14.000+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:14.096 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:14.096 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:14.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:14.096 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:14.096 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:14.103 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:14.101+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:14.104 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:14.204 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:14.202+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:14.206 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:14.206 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:14.207 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:14.207 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:14.215 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:14.254 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:04:14.305 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:14.303+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:14.319 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:14.319 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:14.320 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:14.320 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:14.320 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:14.328 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:14.407 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:14.405+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:14.473 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:14.473 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:14.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 108.233638466, 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:14.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:14.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 107.23213650300001, 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:14.480 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:14.486 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.22626157800001, 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:14.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:14.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:14.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:14.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.492 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.508038685999999, 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.504911008999997, 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:14.497 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:14.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:14.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:14.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.503061979999998, 2024-09-17T23:04:14.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:14.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:14.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:14.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.501747899999998, 2024-09-17T23:04:14.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:14.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:14.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:14.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:14.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.500175366999997, 2024-09-17T23:04:14.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:14.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.517 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.454273145000002, 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:04:14.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:04:14.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:10 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.452954327, 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028104099999999999, 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.522 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 10 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017131+0000", 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4300000000000003e-07 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017140+0000", 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.85e-06 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017147+0000", 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.421e-06 2024-09-17T23:04:14.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017150+0000", 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.675e-06 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017195+0000", 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5126000000000001e-05 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017276+0000", 2024-09-17T23:04:14.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0903999999999997e-05 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.017412+0000", 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013542200000000001 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.263277039000002, 2024-09-17T23:04:14.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.530 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.261384214000003, 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.531 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:14.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:14.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:14.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.536 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.259890274999997, 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:14.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:14.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:14.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.257961551000001, 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.547 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.256063451999999, 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:14.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:14.552 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.255301052, 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:14.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:14.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.269934871, 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:14.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:14.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:14.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.561 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 31.269808056999999, 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:04:14.566 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 26.269008837000001, 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:14.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:04:14.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.268027132, 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:14.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:14.574 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.575 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.575 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.575 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.575 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.575 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:14.576 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:14.577 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:14.574+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:14.677 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:14.674+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:14.680 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:14.680 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:14.680 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:14.680 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:14.688 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:14.737 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:14.737 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:14.737 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-17T23:04:14.737 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T23:04:14.737 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T23:04:14.737 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-17T23:04:14.778 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:14.776+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:14.832 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:14.832 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:14.832 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:14.832 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:14.832 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:14.841 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:14.856 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:14.856 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "" 2024-09-17T23:04:14.856 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:14.879 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:14.877+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:14.980 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:14.978+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 37.023734064999999, 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:14.985 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:14.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:14.988 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 37.018537586000001, 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:14.989 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 37.015726458000003, 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:14.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.997 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.972094147, 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:14.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:15.001 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.971753026999998, 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.002 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.964352933999997, 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:15.006 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.009 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.829138213999997, 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:15.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:15.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.828836965000001, 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.014 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:15.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:15.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.778428165999998, 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.018 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.778111492999997, 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:15.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:15.026 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.771071075999998, 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:15.027 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:15.030 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.770794709, 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:15.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:15.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:15.034 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 36.767511472000002, 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:15.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:15.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:15.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:15.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:15.039 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:15.040 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:15.082 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:15.079+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:15.152 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:15.152 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:15.152 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:15.161 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:15.183 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:15.181+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:15.268 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:15.269 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:15.269 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:15.278 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:15.322 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:15.320+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:15.384 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:15.382+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.96335811900001, 2024-09-17T23:04:15.387 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.388 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:15.389 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:15.390 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.391 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.962911207, 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.392 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:15.393 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.394 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.395 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.94623256600001, 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.396 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.397 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:15.398 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.399 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.400 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.945678896, 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:15.401 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.402 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.403 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:15.404 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.945067272, 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.405 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.406 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:15.407 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:15.408 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.944414573, 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:15.409 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.411 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.412 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:15.413 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.94387843299999, 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:15.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:15.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.417 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.929075236, 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.418 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:15.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.420 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.421 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.928732553, 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:15.422 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.423 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.424 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.425 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.928163168, 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.427 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.428 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.92568298499999, 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.430 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:15.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.91817951900001, 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.434 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:15.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:15.436 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:15.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.91767807399999, 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.439 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:15.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.915042353, 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:15.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:15.445 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:15.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.90718468199999, 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.447 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.448 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.769078858, 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.451 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:15.452 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.453 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:15.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 113.358262072, 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:15.455 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.456 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:15.459 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 112.854428579, 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:15.461 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:15.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.463 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 112.849027459, 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.464 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.465 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.466 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 37.421328611, 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:15.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:15.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:15.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:15.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:15.472 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:15.473 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:15.473 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:15.485 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:15.483+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:15.586 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:15.584+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:15.622 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:15.622 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:15.622 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:15.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:15.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:15.686 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:15.684+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:15.738 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:15.738 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:15.739 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:15.748 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:15.791 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:15.789+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:15.797 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:15.798 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:15.815 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:15.816 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:15.833 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:15.833 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:15.851 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:15.851 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:15.857 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:15.857 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:15.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:15.868 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:15.869 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:15.872 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:15.873 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:15.914 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:15.912+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:15.974 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:15.974 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:15.983 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:16.027 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:16.025+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:16.088 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:16.088 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:16.088 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:16.087+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:16.096 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:16.190 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:16.187+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:16.239 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:16.239 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:16.247 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:16.271 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:04:16.290 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:16.288+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:16.390 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:16.391 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:16.391 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:16.389+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:16.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:16.492 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:16.490+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:16.543 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:16.544 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:16.553 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:16.593 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:16.590+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:16.694 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:16.692+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:16.696 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:16.696 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:16.705 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:16.795 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:16.794+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:16.807 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:16.807 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:16.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:16.896 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:16.894+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:16.918 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:16.918 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:16.928 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:17.013 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:17.011+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:17.071 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:17.071 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:17.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:17.123 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:17.121+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:17.197 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:17.197 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:17.199 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:17.197+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:17.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:17.262 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:04:17.319 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:17.317+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:17.356 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:17.356 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:17.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:17.406 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:17.404+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:17.501 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:17.499+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:17.512 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:17.512 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:17.521 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:17.602 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:17.600+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:17.627 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:17.627 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:17.636 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:17.703 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:17.701+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:17.783 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:17.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:17.835 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:17.833+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:17.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:17.899 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:17.904 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:17.903+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:17.909 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:17.999 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:17.999 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:18.005 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:18.003+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:18.015 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:18.015 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:18.016 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:18.016 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:18.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:18.033 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:18.033 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:18.050 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:18.050 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:18.067 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:18.067 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:18.071 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:18.071 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:18.108 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:18.106+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:18.167 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:18.167 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:18.167 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:18.167 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:18.167 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:18.176 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:18.217 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:18.215+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:18.308 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:18.306+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:18.320 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:18.321 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:18.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:18.321 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:18.321 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:18.329 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:18.409 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:18.407+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:18.433 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:18.433 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:18.433 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:18.433 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:18.441 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:18.510 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:18.507+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:18.585 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:18.585 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:18.585 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:18.585 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:18.585 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:18.594 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:18.610 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:18.608+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:18.699 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 112.459992567, 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.700 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:18.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:18.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.707 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.458490604, 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:18.708 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:18.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:18.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.452615679, 2024-09-17T23:04:18.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:18.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:18.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:18.722 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.734392786999997, 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.723 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:18.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:18.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.731265110000002, 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:18.728 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:18.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.729416080999997, 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:18.735 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:18.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:18.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:18.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:18.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:18.741 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.728102001000003, 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:18.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:18.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.747 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.726529468000003, 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.748 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:18.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.680627246, 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.754 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:04:18.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.48963114, 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:04:18.759 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:04:18.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.487738315000001, 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.765 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:18.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:18.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:18.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.486244376000002, 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.772 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:18.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:18.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.778 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.484315651999999, 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.779 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:18.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:18.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.482417552999998, 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:18.785 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:18.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 40.481655152999998, 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.791 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:18.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:18.795 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 35.496288972000002, 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:18.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:18.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:18.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 35.496162157999997, 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.802 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:18.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:04:18.807 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.495362938, 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:04:18.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:04:18.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:18.812 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.494381232999999, 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:18.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:18.817 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.48929297500000002, 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:18.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:18.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:18.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:18.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:18.822 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:18.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:18.824 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:18.821+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:18.925 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:18.922+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:18.969 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:18.969 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:18.969 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:18.969 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:18.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:19.026 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:19.023+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:19.122 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:19.122 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:19.122 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:19.122 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:19.122 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:19.127 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:19.123+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:19.130 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:19.227 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:19.225+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:19.234 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:19.234 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.273486536999997, 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.235 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:19.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:19.237 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:19.238 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.268290057999998, 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:19.239 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:19.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.26547893, 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.245 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:19.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:19.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.221846618999997, 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:19.252 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.221505499000003, 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:19.253 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:19.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.214105406000002, 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:19.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:19.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.261 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.078890686000001, 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:19.262 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.266 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.078589436999998, 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:19.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.268 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:19.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:19.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:19.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:19.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:19.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.272 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.028180638000002, 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:19.273 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.274 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:19.274 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:19.274 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:19.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.274 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:19.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:19.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:19.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:19.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:19.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.027863965000002, 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:19.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.020823548000003, 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.283 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:19.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:19.287 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.020547180999998, 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:19.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:19.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 41.017263944, 2024-09-17T23:04:19.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:19.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:19.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.297 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:19.298 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:19.298 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:19.298 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:04:19.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:19.345 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:19.342+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:19.422 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:19.422 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:19.422 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:19.422 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:19.429 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:19.426+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:19.432 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:19.530 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:19.527+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:19.579 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:19.579 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:19.579 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:19.580 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:19.580 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:19.589 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:19.631 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:19.629+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:19.732 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:19.728+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.313264944, 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:19.737 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:19.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.741 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.312818032, 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.742 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:19.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.744 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.296139391, 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:19.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:19.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.29558572099999, 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:19.750 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:19.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:19.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.29497409699999, 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.755 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.756 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.29432139799999, 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.761 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:19.763 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.293785258, 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.766 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.27898206099999, 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:19.768 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:19.769 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.770 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.771 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:19.772 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.27863937799999, 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.773 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:19.775 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.278069993, 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:19.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:19.780 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.27558981, 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:19.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:19.785 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.268086344, 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:19.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:19.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:19.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:19.789 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.267584899, 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.26494917799999, 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.794 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:19.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:19.798 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.257091507, 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:19.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:19.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 118.11898568300001, 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:19.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 117.70816889699999, 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:19.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:19.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 117.20433540400001, 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:19.811 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:19.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.815 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 117.198934284, 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.819 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 41.771235435999998, 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:19.820 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:19.824 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:19.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:19.825 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:19.826 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:19.832 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:19.830+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:19.866 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:19.866 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:19.866 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-17T23:04:19.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2024-09-17T23:04:19.933 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:19.931+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:19.976 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:19.976 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:19.976 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:19.976 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:19.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:20.034 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:20.032+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:20.072 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:20.096 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:20.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:20.147 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:20.144+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:20.167 INFO:teuthology.orchestra.run.smithi005.stdout:moved 0 / 18 (0%) 2024-09-17T23:04:20.167 INFO:teuthology.orchestra.run.smithi005.stdout:avg 3.6 2024-09-17T23:04:20.167 INFO:teuthology.orchestra.run.smithi005.stdout:stddev 2.15407 -> 2.15407 (expected baseline 1.69706) 2024-09-17T23:04:20.167 INFO:teuthology.orchestra.run.smithi005.stdout:min osd.3 with 1 -> 1 pgs (0.277778 -> 0.277778 * mean) 2024-09-17T23:04:20.167 INFO:teuthology.orchestra.run.smithi005.stdout:max osd.0 with 3 -> 3 pgs (0.833333 -> 0.833333 * mean) 2024-09-17T23:04:20.168 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:20.168 INFO:teuthology.orchestra.run.smithi005.stdout:oload 1000 2024-09-17T23:04:20.168 INFO:teuthology.orchestra.run.smithi005.stdout:max_change 3 2024-09-17T23:04:20.168 INFO:teuthology.orchestra.run.smithi005.stdout:max_change_osds 4 2024-09-17T23:04:20.168 INFO:teuthology.orchestra.run.smithi005.stdout:average_utilization 0.0003 2024-09-17T23:04:20.168 INFO:teuthology.orchestra.run.smithi005.stdout:overload_utilization 0.0032 2024-09-17T23:04:20.168 INFO:teuthology.orchestra.run.smithi005.stderr:no change 2024-09-17T23:04:20.182 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-17T23:04:20.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-17T23:04:20.200 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:20.200 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:20.201 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:20.218 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:20.218 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:20.235 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:20.232+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:20.236 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:20.236 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:20.253 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:20.254 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:20.259 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:20.259 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:20.269 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:20.269 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:04:20.274 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:20.274 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:20.274 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:20.277 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:20.278 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:20.335 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:20.332+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:20.377 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:20.377 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:20.386 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:20.436 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:20.433+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:20.490 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:20.490 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:20.498 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:20.501 INFO:teuthology.orchestra.run.smithi005.stdout:moved 0 / 18 (0%) 2024-09-17T23:04:20.501 INFO:teuthology.orchestra.run.smithi005.stdout:avg 3.6 2024-09-17T23:04:20.501 INFO:teuthology.orchestra.run.smithi005.stdout:stddev 2.15407 -> 2.15407 (expected baseline 1.69706) 2024-09-17T23:04:20.501 INFO:teuthology.orchestra.run.smithi005.stdout:min osd.3 with 1 -> 1 pgs (0.277778 -> 0.277778 * mean) 2024-09-17T23:04:20.501 INFO:teuthology.orchestra.run.smithi005.stdout:max osd.0 with 3 -> 3 pgs (0.833333 -> 0.833333 * mean) 2024-09-17T23:04:20.501 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:20.502 INFO:teuthology.orchestra.run.smithi005.stdout:oload 1000 2024-09-17T23:04:20.502 INFO:teuthology.orchestra.run.smithi005.stdout:max_change 3 2024-09-17T23:04:20.502 INFO:teuthology.orchestra.run.smithi005.stdout:max_change_osds 4 2024-09-17T23:04:20.502 INFO:teuthology.orchestra.run.smithi005.stdout:average_utilization 0.0003 2024-09-17T23:04:20.502 INFO:teuthology.orchestra.run.smithi005.stdout:overload_utilization 0.0032 2024-09-17T23:04:20.502 INFO:teuthology.orchestra.run.smithi005.stderr:no change 2024-09-17T23:04:20.514 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-17T23:04:20.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-17T23:04:20.555 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:20.552+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:20.601 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:20.601 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:20.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:20.638 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:20.635+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:20.716 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:20.717 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:20.725 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:20.768 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:20.766+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:20.828 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:20.829 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:20.837 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:20.843 INFO:teuthology.orchestra.run.smithi005.stdout:moved 0 / 18 (0%) 2024-09-17T23:04:20.843 INFO:teuthology.orchestra.run.smithi005.stdout:avg 3.6 2024-09-17T23:04:20.843 INFO:teuthology.orchestra.run.smithi005.stdout:stddev 2.15407 -> 2.15407 (expected baseline 1.69706) 2024-09-17T23:04:20.843 INFO:teuthology.orchestra.run.smithi005.stdout:min osd.3 with 1 -> 1 pgs (0.277778 -> 0.277778 * mean) 2024-09-17T23:04:20.843 INFO:teuthology.orchestra.run.smithi005.stdout:max osd.0 with 3 -> 3 pgs (0.833333 -> 0.833333 * mean) 2024-09-17T23:04:20.843 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:20.843 INFO:teuthology.orchestra.run.smithi005.stdout:oload 110 2024-09-17T23:04:20.844 INFO:teuthology.orchestra.run.smithi005.stdout:max_change 1 2024-09-17T23:04:20.844 INFO:teuthology.orchestra.run.smithi005.stdout:max_change_osds 4 2024-09-17T23:04:20.844 INFO:teuthology.orchestra.run.smithi005.stdout:average_utilization 0.0003 2024-09-17T23:04:20.844 INFO:teuthology.orchestra.run.smithi005.stdout:overload_utilization 0.0003 2024-09-17T23:04:20.844 INFO:teuthology.orchestra.run.smithi005.stderr:no change 2024-09-17T23:04:20.856 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-17T23:04:20.856 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-17T23:04:20.878 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:20.876+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:20.941 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:20.937+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:20.981 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:20.982 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:20.990 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:21.041 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:21.038+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:21.094 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:21.094 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:21.103 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:21.147 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:21.145+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:moved 0 / 18 (0%) 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:avg 3.6 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:stddev 2.15407 -> 2.15407 (expected baseline 1.69706) 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:min osd.3 with 1 -> 1 pgs (0.277778 -> 0.277778 * mean) 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:max osd.0 with 3 -> 3 pgs (0.833333 -> 0.833333 * mean) 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:oload 110 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:max_change 1 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:max_change_osds 4 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:average_utilization 0.0003 2024-09-17T23:04:21.189 INFO:teuthology.orchestra.run.smithi005.stdout:overload_utilization 0.0003 2024-09-17T23:04:21.190 INFO:teuthology.orchestra.run.smithi005.stderr:no change 2024-09-17T23:04:21.202 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-17T23:04:21.202 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-17T23:04:21.206 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:21.207 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:21.215 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:21.256 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:21.254+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:21.345 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:21.343+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:21.359 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:21.359 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:21.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:21.446 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:21.444+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:21.477 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:21.477 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:21.486 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:21.535 INFO:teuthology.orchestra.run.smithi005.stdout:moved 0 / 18 (0%) 2024-09-17T23:04:21.535 INFO:teuthology.orchestra.run.smithi005.stdout:avg 3.6 2024-09-17T23:04:21.535 INFO:teuthology.orchestra.run.smithi005.stdout:stddev 2.15407 -> 2.15407 (expected baseline 1.69706) 2024-09-17T23:04:21.535 INFO:teuthology.orchestra.run.smithi005.stdout:min osd.3 with 1 -> 1 pgs (0.277778 -> 0.277778 * mean) 2024-09-17T23:04:21.536 INFO:teuthology.orchestra.run.smithi005.stdout:max osd.0 with 3 -> 3 pgs (0.833333 -> 0.833333 * mean) 2024-09-17T23:04:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:21.536 INFO:teuthology.orchestra.run.smithi005.stdout:oload 1000 2024-09-17T23:04:21.536 INFO:teuthology.orchestra.run.smithi005.stdout:max_change 3 2024-09-17T23:04:21.536 INFO:teuthology.orchestra.run.smithi005.stdout:max_change_osds 4 2024-09-17T23:04:21.536 INFO:teuthology.orchestra.run.smithi005.stdout:average_utilization 0.0003 2024-09-17T23:04:21.536 INFO:teuthology.orchestra.run.smithi005.stdout:overload_utilization 0.0032 2024-09-17T23:04:21.536 INFO:teuthology.orchestra.run.smithi005.stderr:no change 2024-09-17T23:04:21.546 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:21.544+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:21.593 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:21.594 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:21.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:21.647 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:21.644+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:21.709 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:21.710 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:21.718 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:21.748 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:21.746+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:21.849 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:21.846+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:21.865 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:21.865 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:21.874 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:21.950 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:21.948+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:22.021 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:22.022 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:22.030 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:22.051 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:22.049+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:22.137 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:22.137 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:22.146 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:22.189 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:22.187+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:22.252 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:22.249+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:22.254 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:22.254 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:22.262 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:22.279 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:22.289 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:04:22.352 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:22.350+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:22.405 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:22.405 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:22.406 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:22.406 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:22.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:22.423 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:22.423 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:22.441 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:22.442 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:22.454 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:22.450+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:22.458 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:22.458 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:22.475 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:22.475 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:22.476 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:22.479 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:22.480 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:22.555 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:22.553+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:22.558 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:22.558 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:22.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:22.558 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:22.558 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:22.567 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:22.656 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:22.654+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:22.711 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:22.711 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:22.711 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:22.711 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:22.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:22.763 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:22.761+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:22.822 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:22.822 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:22.822 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:22.823 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:22.823 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:22.831 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:22.872 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:22.870+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:22.959 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:22.957+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:22.976 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:22.976 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:22.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:22.976 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:22.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.976 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:22.976 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 116.736702444, 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:22.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:22.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.982 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.73520048100001, 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:22.983 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:22.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:22.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:22.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:22.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:22.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 114.72932555600001, 2024-09-17T23:04:22.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:22.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:22.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:22.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:22.995 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.011102663999999, 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:22.996 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:22.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:22.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.007974986999997, 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:23.001 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:23.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.006125957999998, 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:23.007 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.004811877999998, 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.012 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.014 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:23.016 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.003239344999997, 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.957337123000002, 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029730300000000001, 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015812+0000", 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015813+0000", 2024-09-17T23:04:23.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9500000000000001e-07 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015817+0000", 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4349999999999999e-06 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015828+0000", 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0857e-05 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015833+0000", 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015874+0000", 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1146000000000002e-05 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.015921+0000", 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6953999999999998e-05 2024-09-17T23:04:23.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.016109+0000", 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018792 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.766341017000002, 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.026 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:23.030 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.764448192000003, 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:23.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:23.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:23.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.035 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.762954252999997, 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.036 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:23.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:23.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:23.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.040 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:23.041 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.761025529000001, 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.042 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:23.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.044 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.046 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.759127429999999, 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.047 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:23.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:23.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:23.051 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.75836503, 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:23.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:23.055 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.772998848999997, 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.056 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:23.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.772872034999999, 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:23.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 34.772072815000001, 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.066 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:04:23.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:04:23.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.77109111, 2024-09-17T23:04:23.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.7660028519999997, 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.075 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.076 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:23.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.079 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:23.081 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:23.081 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:23.078+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:23.181 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:23.178+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:23.225 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:23.225 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:23.225 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:23.225 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:23.233 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:23.277 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:04:23.282 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:23.279+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:23.338 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:23.339 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:23.339 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:23.339 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:23.339 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:23.347 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:23.383 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:23.380+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:23.484 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:23.481+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:23.491 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.530292764999999, 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:23.492 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:23.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:23.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:23.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:23.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:23.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:23.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:23.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:23.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:23.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:23.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.498 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.525096286, 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:23.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.522285158000003, 2024-09-17T23:04:23.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:23.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.478652846999999, 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:23.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.478311726999998, 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.514 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:23.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:23.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:23.518 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.470911633999997, 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:23.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.335696914000003, 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.523 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:23.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:23.527 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.335395665, 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:23.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:23.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:23.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.284986865999997, 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.284670192999997, 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:23.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:23.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.277629775999998, 2024-09-17T23:04:23.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:23.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:23.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.277353409, 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.546 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.547 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 45.274070172000002, 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:23.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:23.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:23.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:23.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:23.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:23.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:23.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:23.556 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.556 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.556 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.557 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:23.557 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:23.557 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:23.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:23.599 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:23.597+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:23.679 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:23.679 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:23.679 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:23.679 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:23.686 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:23.684+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:23.688 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:23.787 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:23.784+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:23.797 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:23.797 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:23.797 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:23.797 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:23.797 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:23.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:23.889 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:23.886+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:23.954 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:23.954 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:23.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:23.954 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.53058075600001, 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:23.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:23.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.53013384400001, 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.959 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.960 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:23.961 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:23.962 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.51345520300001, 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:23.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:23.966 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:23.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.512901533, 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.968 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:23.969 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.970 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.972 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.512289909, 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.973 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:23.974 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.975 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.51163721, 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.979 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.51110107, 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.982 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.983 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:23.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.985 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:23.986 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.496297873, 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:23.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.991 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.49595519, 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.992 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:23.994 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:23.995 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.495385805, 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:23.996 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:23.997 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:23.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:24.000 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.49290562199999, 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.001 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.003 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.48540215600001, 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:24.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.48490071099999, 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.010 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.48226499, 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:24.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.47440731899999, 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:24.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 122.336301495, 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.023 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:24.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.027 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 121.925484709, 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 121.421651216, 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.032 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:24.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:24.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 121.416250096, 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:24.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:24.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 45.988551248, 2024-09-17T23:04:24.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:24.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.046 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.047 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:24.048 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:24.048 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:24.044+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:24.149 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:24.147+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:24.195 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:24.195 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:24.195 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:24.195 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:24.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:24.249 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:24.246+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:24.312 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:24.312 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:24.312 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:24.312 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:24.312 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:24.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:24.361 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:24.358+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:24.451 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:24.449+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:24.467 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:24.467 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:24.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:24.467 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:24.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 14.873193828, 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.468 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:24.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:24.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.471 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:24.472 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:24.472 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:24.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:24.480 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:24.551 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:24.548+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:24.586 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:24.587 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:24.587 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:24.587 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:24.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:24.602 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:24.603 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:24.603 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:24.603 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:24.620 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:24.620 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:24.637 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:24.637 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:24.653 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:24.649+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:24.653 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:24.654 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:24.670 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:24.671 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:24.674 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:24.674 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:24.699 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:24.699 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:24.708 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:24.754 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:24.751+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:24.811 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:24.811 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:24.819 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:24.863 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:24.861+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:24.921 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:24.922 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:24.930 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:24.971 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:24.969+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:25.057 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:25.054+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:25.072 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:25.073 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:25.082 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:25.158 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:25.156+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:25.225 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:25.226 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:25.235 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:25.259 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:25.256+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:25.293 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:04:25.339 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:25.339 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:25.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:25.360 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:25.357+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:25.451 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:25.451 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:25.461 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:25.461 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:25.458+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:25.561 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:25.559+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:25.605 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:25.605 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:25.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:25.662 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:25.659+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:25.721 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:25.722 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:25.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:25.763 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:25.761+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:25.864 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:25.862+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:25.877 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:25.877 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:25.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:25.965 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:25.963+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:25.992 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:25.992 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:26.001 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:26.066 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:26.064+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:26.108 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:26.108 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:26.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:26.167 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:26.164+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:26.224 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:26.224 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:26.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:26.268 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:26.266+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:26.282 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:04:26.369 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:26.366+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:26.383 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:26.383 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:26.391 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:26.470 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:26.468+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:26.498 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:26.498 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:26.507 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:26.549 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:26.549 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:26.550 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-17T23:04:26.550 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T23:04:26.550 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T23:04:26.550 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-17T23:04:26.592 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:26.590+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:26.651 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:26.651 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:26.657 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:26.657 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "" 2024-09-17T23:04:26.657 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:26.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:26.671 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:26.669+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:26.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:26.772 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:26.770+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:26.799 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:26.800 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:26.803 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:26.803 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:26.813 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:26.816 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:26.816 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:26.833 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:26.833 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:26.850 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:26.850 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:26.867 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:26.868 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:26.871 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:26.871 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:26.897 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:26.895+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:26.956 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:26.956 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:26.956 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:26.956 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:26.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:27.006 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:27.004+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:27.074 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:27.072+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:27.110 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:27.110 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:27.110 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:27.110 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:27.110 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:27.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:27.176 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:27.173+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:27.264 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 121.024573882, 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.265 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:27.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:27.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:27.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:27.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 120.023071919, 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:27.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:27.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 119.017196994, 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:27.280 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:27.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:27.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:27.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.298974102000003, 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.287 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:27.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:27.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.295846425000001, 2024-09-17T23:04:27.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:27.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:27.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.293997396000002, 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:27.297 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:27.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:27.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:27.302 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.292683316000002, 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:27.303 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:27.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.291110783000001, 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.308 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:27.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:27.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.313 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.054212454999998, 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029841600000000002, 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206808+0000", 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206809+0000", 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6300000000000005e-07 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206811+0000", 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7010000000000001e-06 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206817+0000", 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8769999999999998e-06 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206827+0000", 2024-09-17T23:04:27.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0251000000000001e-05 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206866+0000", 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8868000000000001e-05 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.206921+0000", 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4636999999999999e-05 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.317 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.207106+0000", 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018541900000000001 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.05231963, 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.318 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:27.323 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.050825691, 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.324 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:27.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.327 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.329 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.048896966999997, 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.330 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:27.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:27.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.046998868000003, 2024-09-17T23:04:27.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.337 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:27.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.046236467999996, 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:27.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:27.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.060870287, 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.345 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:27.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.060743473000002, 2024-09-17T23:04:27.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.059944252999998, 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.356 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:04:27.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 34.058962547999997, 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:27.360 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:27.364 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 9.0538742899999995, 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:27.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.052871176, 2024-09-17T23:04:27.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:27.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:04:27.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:04:27.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:04:27.374 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.374 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.374 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.374 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.374 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.374 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:27.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:27.376 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:27.373+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:27.475 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:27.473+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:27.520 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:27.520 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:27.520 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:27.520 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:27.528 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:27.577 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:27.574+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:27.672 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:27.672 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:27.672 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:27.672 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:27.672 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:27.678 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:27.675+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:27.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:27.779 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:27.776+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.864683841000002, 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:27.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.859487362000003, 2024-09-17T23:04:27.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:27.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.856676233999998, 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:27.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.837 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:27.839 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.813043923000002, 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:27.840 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:27.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:27.844 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.812702803000001, 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:27.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.805302709999999, 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.849 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:27.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.853 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.670087989999999, 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:27.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.669786741000003, 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:27.858 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:27.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.619377942, 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:27.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.619061268999999, 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.867 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.871 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.612020852000001, 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.872 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:27.875 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.611744485000003, 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.876 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.877 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.878 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:27.879 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 49.608461247999998, 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:27.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:27.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:27.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:27.884 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:27.886 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:27.883+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:27.886 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:27.986 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:27.984+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:28.006 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:28.006 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:28.006 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:28.015 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:28.087 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:28.085+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:28.164 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:28.164 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:28.164 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:28.172 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:28.216 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:28.214+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:28.281 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:28.281 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.857201807, 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:28.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.283 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:28.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:28.286 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.85675489499999, 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:28.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:28.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.840076254, 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.291 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:28.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.83952258399999, 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:28.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.300 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.83891096000001, 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:28.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.83825826099999, 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:28.305 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:28.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:28.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.837722121, 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:28.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.314 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.82291892400001, 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:28.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.82257624099999, 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:28.319 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:28.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.323 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.822006856, 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.324 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:28.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.819526673, 2024-09-17T23:04:28.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:28.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:28.332 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.812023207, 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.336 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:28.337 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.811521762, 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.338 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.339 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.340 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.80888604099999, 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.342 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:28.344 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.345 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.346 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.80102837, 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.347 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:28.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.351 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.662922546, 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:28.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.355 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 126.25210576000001, 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:28.356 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.357 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.358 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.359 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.360 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 125.748272267, 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.361 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.362 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:28.363 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:28.364 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 125.742871147, 2024-09-17T23:04:28.365 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.366 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:28.367 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.368 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:28.369 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 50.315172298999997, 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:28.370 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.371 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:28.372 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:28.373 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.374 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:28.375 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:28.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.375 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.375 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.375 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:28.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:04:28.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:28.377 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:28.374+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:28.477 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:28.475+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:28.526 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:28.526 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:28.526 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:28.527 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:28.538 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:28.579 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:28.577+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:28.646 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:28.646 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:28.646 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:28.646 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:28.646 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:28.655 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:28.699 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:28.697+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 19.16768823, 2024-09-17T23:04:28.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:28.763 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:28.766 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:28.770 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:28.815 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:28.813+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:28.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:28.882 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:28.879+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:28.886 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:28.886 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:28.886 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:28.886 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:28.895 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:28.982 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:28.980+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:28.995 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:28.995 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:29.012 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:29.012 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:29.030 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:29.030 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:29.040 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:29.041 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:29.046 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:29.047 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:29.049 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:29.064 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:29.064 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:29.068 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:29.068 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:29.093 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:29.091+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:29.153 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:29.153 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:29.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:29.184 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:29.182+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:29.286 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:29.284+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:29.548 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:04:29.548 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:29.549 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:29.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:29.549 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:29.546+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:29.648 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:29.646+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:29.691 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:29.691 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:29.701 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:29.785 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:29.783+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:29.845 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:29.845 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:29.849 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:29.847+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:29.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:29.950 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:29.948+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:29.995 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:29.996 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:30.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:30.051 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:30.049+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:30.107 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:30.107 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:30.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:30.159 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:30.157+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:30.219 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:30.219 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:30.228 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:30.273 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:30.271+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:30.350 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:30.353 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:30.351+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:30.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:30.454 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:30.452+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:30.510 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:30.510 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:30.518 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:30.555 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:30.553+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:30.656 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:30.654+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:30.666 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:30.666 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:30.675 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:30.757 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:30.755+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:30.782 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:30.782 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:30.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:30.858 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:30.856+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:30.898 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:30.898 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:30.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:30.960 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:30.958+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:31.014 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:31.014 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:31.023 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:31.061 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:31.059+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:31.069 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:31.133 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:31.133 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:31.142 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:31.161 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:31.159+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:31.192 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:31.193 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:31.210 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:31.210 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:31.227 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:31.227 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:31.244 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:31.245 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:31.246 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:31.246 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:31.246 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:31.246 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:31.246 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:31.256 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:31.261 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:31.262 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:31.262 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:31.262 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:31.259+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:31.265 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:31.265 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:31.359 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:31.359 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:31.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:31.359 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:31.359 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:31.363 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:31.360+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:31.368 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:31.463 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:31.461+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:31.472 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:31.472 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:31.472 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:31.472 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:31.480 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:31.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:04:31.564 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:31.562+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:31.624 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:31.624 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:31.624 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:31.625 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:31.625 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:31.633 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:31.665 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:31.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:31.666 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-17T23:04:31.666 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.921004 2024-09-17T23:04:31.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.9210038015388551 2024-09-17T23:04:31.674 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:31.672+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:31.766 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:31.764+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:31.778 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:31.778 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:31.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:31.778 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:31.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.778 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 125.538712739, 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:31.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:31.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 124.53721077599999, 2024-09-17T23:04:31.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:31.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:31.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.791 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 123.53133585099999, 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:31.792 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:31.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:31.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:31.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:31.798 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.813112959000001, 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.799 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:31.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.803 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.809985282, 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:31.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.809 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.808136253000001, 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:31.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.806822173, 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.815 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:31.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.819 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.80524964, 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:31.820 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:31.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:31.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.566458486999998, 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.825 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:31.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:31.830 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.564964547999999, 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.831 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:31.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.836 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.563035823999996, 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.837 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:31.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:31.841 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.561137725000002, 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:31.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.560375325000003, 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.847 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:31.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.575009143999999, 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.852 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:31.853 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.856 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.574882330000001, 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.857 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.858 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:31.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:31 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 43.574083109999997, 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031532499999999998, 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.862 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201076+0000", 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201077+0000", 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2999999999999999e-07 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201082+0000", 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.507e-06 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201092+0000", 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3230000000000004e-06 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201103+0000", 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1025e-05 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201227+0000", 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012425700000000001 2024-09-17T23:04:31.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201296+0000", 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8521000000000003e-05 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:48.201391+0000", 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5861999999999998e-05 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.573101405000003, 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.867 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:31.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.871 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 13.568013147, 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.872 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:31.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.876 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 8.5670100330000007, 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.877 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:04:31.878 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.879 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:04:31.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.5669931689999999, 2024-09-17T23:04:31.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:31.883 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.884 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.885 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.886 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.886 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:31.886 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:31.886 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:31.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:31.888 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:31.885+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:31.988 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:31.986+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:32.032 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:32.032 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:32.033 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:32.033 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:32.041 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:32.126 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:32.124+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:32.185 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:32.185 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:32.185 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:32.185 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:32.185 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:32.189 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:32.187+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:32.194 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:32.290 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:32.288+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:32.295 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.1 primary-affinity to 0.921004 (8603582) 2024-09-17T23:04:32.298 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:04:32.339 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.339 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.378138745999998, 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:32.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.343 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.372942266999999, 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:32.344 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:32.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:32.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.370131139000001, 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.326498827999998, 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.326157707999997, 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.318757615000003, 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.183542895000002, 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.183241645999999, 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:32.371 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:32.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.375 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.132832847000003, 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:32.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.378 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.379 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.132516174000003, 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:32.380 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:32.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.125475756999997, 2024-09-17T23:04:32.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:32.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.388 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.125199389999999, 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:32.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 54.121916153000001, 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.393 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:32.394 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.395 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:32.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:32.397 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:32.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:32.399 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:32.396+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:32.499 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:32.497+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:32.508 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:32.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:32.509 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:32.509 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:32.517 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:32.600 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:32.598+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:32.624 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:32.624 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:32.624 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:32.624 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:32.625 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:32.633 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:32.701 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:32.699+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:32.782 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.35882455500001, 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.783 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:32.787 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.35837764300001, 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:32.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.34169900200001, 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.792 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:32.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.796 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.341145332, 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:32.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:32.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.801 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.34053370800001, 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.802 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.803 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:32.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.33988100900001, 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.807 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:32.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:32.811 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.339344869, 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:32.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:32.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:32.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:32.816 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.32454167200001, 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:32.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.820 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.324198989, 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.821 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:32.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.32362960399999, 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:32.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.321149421, 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.830 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:32.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:32.833 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.313645955, 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:32.836 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:32.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.31314451, 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:32.839 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:32.841 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.842 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:32.843 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.31050878900001, 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.844 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:32.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.846 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.847 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:32.848 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.302651118, 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:32.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:32.851 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.852 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 131.16454529399999, 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.853 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.854 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.855 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:32.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 130.75372850799999, 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:32.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 130.24989501499999, 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:32.862 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:32.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:32.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 130.24449389500001, 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:32.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:32.871 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 54.816795046999999, 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:32.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:32.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:32.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.876 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:32.877 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:32.877 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:32.878 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:32.879 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:32.876+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:32.979 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:32.977+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:32.985 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:32.986 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:32.986 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:32.986 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:32.994 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:33.080 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:33.078+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:33.101 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:33.101 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:33.101 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:33.101 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:33.101 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:33.109 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:33.193 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:33.191+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:33.257 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:33.257 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:33.257 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:33.257 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:33.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.257 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 23.662894236, 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:33.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:33.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:33.261 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:33.266 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:33.266 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:33.307 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:33.305+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:33.373 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:33.373 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:33.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:33.382 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:33.380+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:33.430 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:33.431 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:33.448 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:33.448 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:33.465 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:33.465 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:33.483 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:33.483 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:33.483 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:33.481+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:33.485 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:33.485 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:33.495 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:33.499 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:33.500 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:33.503 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:33.503 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:33.584 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:33.582+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:33.639 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:33.639 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:33.648 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:33.691 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:33.689+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:33.750 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:33.751 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:33.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:33.787 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:33.784+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:33.888 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:33.886+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:33.901 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:33.901 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:33.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:33.989 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:33.987+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:34.053 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:34.053 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:34.061 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:34.105 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:34.103+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:34.163 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:34.163 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:34.172 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:34.190 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:34.188+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:34.291 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:34.289+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:34.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:04:34.317 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:34.317 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:34.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:34.392 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:34.390+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:34.429 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:34.430 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:34.438 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:34.493 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:34.491+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:34.548 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:34.549 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:34.557 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:34.601 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:34.599+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:34.665 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:34.665 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:34.673 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:34.694 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:34.692+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:34.795 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:34.793+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:34.821 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:34.821 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:34.830 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:34.895 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:34.893+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:34.937 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:34.937 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:34.946 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:35.030 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:35.028+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:35.093 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:35.094 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:35.098 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:35.096+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:35.102 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:35.199 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:35.197+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:35.249 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:35.249 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:35.258 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:35.301 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:35.299+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:35.304 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:04:35.363 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:35.363 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:35.371 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:35.401 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:35.399+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:35.503 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:35.501+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:35.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:35.513 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:35.513 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:35.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:35.603 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:35.601+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:35.625 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:35.625 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:35.629 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:35.630 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:35.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:35.647 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:35.647 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:35.664 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:35.664 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:35.681 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:35.681 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:35.697 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:35.698 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:35.698 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:35.702 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:35.702 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:35.704 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:35.702+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:35.777 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:35.778 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:35.778 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:35.778 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:35.786 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:35.830 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:35.828+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:35.890 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:35.890 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:35.890 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:35.890 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:35.890 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:35.898 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:35.939 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:35.937+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:36.006 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:36.004+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:36.044 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:36.044 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:36.044 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:36.044 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:36.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 129.80455336200001, 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.045 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:36.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:36.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 128.803051399, 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.052 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:36.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:36.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:36.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 127.797176474, 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:36.058 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:36.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.061 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.064 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.078953581999997, 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:36.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.066 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.075825905000002, 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.069 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:36.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.073976876000003, 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.075 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.072662796000003, 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.080 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:36.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:36.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.071090263000002, 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.085 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.086 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:36.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:36.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:36.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.832299110000001, 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.090 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:36.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.095 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.830805171000002, 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.096 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:36.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:36.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.828876446999999, 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.102 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.826978347999997, 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.107 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:36.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:36.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.826215947999998, 2024-09-17T23:04:36.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.116 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 52.840849767000002, 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.121 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 52.840722952999997, 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:36.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:36.126 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 42.838942027999998, 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.127 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 17.833853770000001, 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.132 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:36.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.135 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 12.832850656, 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:04:36.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:04:36.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.139 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 7.8328337919999997, 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.140 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 2.831922563, 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.144 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.148 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:36.149 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:36.150 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:36.147+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:36.250 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:36.247+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:36.293 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:36.293 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:36.293 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:36.293 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:36.302 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:36.386 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:36.384+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:36.446 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:36.446 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:36.447 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:36.447 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:36.447 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:36.452 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:36.450+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:36.456 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:36.553 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:36.551+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:36.601 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:36.601 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:36.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.640258514999999, 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:36.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:36.605 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.635062036000001, 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:36.606 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:36.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.632250908000003, 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.611 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:36.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.588618597, 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:36.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:36.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.588277476999998, 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:36.620 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:36.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.580877383999997, 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.625 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:36.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.445662663999997, 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.629 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:36.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:36.633 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.445361415000001, 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:36.634 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:36.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.638 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.394952615999998, 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:36.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.394635942999997, 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:36.643 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:36.647 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.387595525999998, 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.648 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:36.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.387319159, 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:36.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:36.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.655 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 58.384035922000002, 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:36.656 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:36.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:36.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:36.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:36.660 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:36.662 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:36.662 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:36.659+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:36.762 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:36.760+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:36.782 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:36.782 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:36.782 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:36.783 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:36.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:36.863 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:36.861+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:36.941 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:36.941 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:36.941 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:36.941 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:36.941 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:36.950 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:36.964 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:36.962+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:37.058 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:37.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.63463805399999, 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:37.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.062 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.63419114199999, 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.063 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.064 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:37.065 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:37.066 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.067 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.61751250099999, 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.068 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.069 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.070 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.071 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.61695883100001, 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.072 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.073 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.074 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.075 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.076 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.61634720699999, 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.077 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.078 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.079 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:37.080 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.61569450799999, 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.081 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.082 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.083 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:37.084 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.61515836800001, 2024-09-17T23:04:37.085 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.086 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:37.087 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.088 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.089 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.60035517099999, 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.090 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.091 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:37.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.600012488, 2024-09-17T23:04:37.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.096 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.097 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:37.098 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.599443103, 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:37.099 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.100 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.102 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.59696292000001, 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:37.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:37.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:37.107 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.58945945400001, 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:37.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:37.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.58895800900001, 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.112 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:37.116 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.117 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.117 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.117 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:37.117 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:37.117 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.58632228799999, 2024-09-17T23:04:37.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:37.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.121 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.57846461700001, 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:37.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:37.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:37.126 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.440358793, 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:37.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:37.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 135.029542007, 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:37.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 134.525708514, 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.135 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:37.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:37.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 134.52030739400001, 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:37.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 59.092608546000001, 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:37.144 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:37.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.149 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:37.151 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:37.151 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:37.148+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:37.252 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:37.250+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:37.300 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:37.300 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:37.300 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:37.300 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:37.309 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:37.312 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:37.312 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:37.312 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-17T23:04:37.312 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T23:04:37.312 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T23:04:37.312 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-17T23:04:37.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:04:37.356 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:37.354+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:37.418 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:37.418 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:37.418 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:37.418 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:37.418 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:37.418 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:37.418 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-17T23:04:37.419 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:37.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:37.469 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:37.467+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:37.537 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:37.537 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:37.537 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:37.537 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:37.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.537 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:37.537 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:37.537 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 27.942615965000002, 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:37.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:37.539 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.541 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:37.542 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:37.542 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:37.546 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:37.590 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:37.588+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:37.651 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:37.651 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:37.651 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:37.651 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:37.655 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:37.653+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:37.660 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:37.702 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:37.756 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:37.753+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:37.804 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:37.805 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:37.805 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:37.805 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:37.805 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:37.813 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:37.826 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:37.827 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:37.844 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:37.844 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:37.857 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:37.855+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:37.861 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:37.861 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:37.878 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:37.878 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:37.894 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:37.895 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:37.898 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:37.899 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:37.958 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:37.956+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:37.958 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:37.959 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:37.967 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:38.059 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:38.056+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:38.110 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:38.111 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:38.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:38.160 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:38.158+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:38.222 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:38.222 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:38.231 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:38.275 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:38.273+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:38.310 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:04:38.335 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:38.336 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:38.345 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:38.367 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:38.365+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:38.462 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:38.460+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:38.490 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:38.491 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:38.500 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:38.583 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:38.581+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:38.643 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:38.643 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:38.652 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:38.693 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:38.691+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:38.765 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:38.763+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:38.796 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:38.797 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:38.805 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:38.866 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:38.864+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:38.925 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:38.926 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:38.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:38.967 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:38.965+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:39.068 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:39.066+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:39.082 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:39.082 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:39.091 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:39.169 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:39.167+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:39.198 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:39.199 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:39.207 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:39.270 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:39.267+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:39.316 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:39.316 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:39.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:39.370 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:39.368+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:39.432 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:39.432 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:39.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:39.471 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:39.469+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:39.576 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:39.574+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:39.589 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:39.589 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:39.597 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:39.672 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:39.670+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:39.705 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:39.705 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:39.714 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:39.798 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:39.796+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:39.859 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:39.859 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:39.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:39.874 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:39.872+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:39.899 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:39.974 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:39.972+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:40.011 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:40.011 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:40.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:40.024 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:40.025 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:40.042 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:40.042 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:40.060 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:40.060 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:40.075 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:40.073+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:40.077 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:40.077 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:40.094 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:40.094 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:40.098 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:40.098 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:40.163 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:40.163 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:40.164 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:40.164 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:40.172 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:40.216 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:40.214+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:40.276 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:40.274+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:40.277 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:40.277 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:40.277 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:40.277 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:40.277 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:40.285 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:40.326 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:04:40.377 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:40.375+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:40.429 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 134.189662462, 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.430 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:40.431 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:40.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:40.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:40.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 133.18816049899999, 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:40.437 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:40.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:40.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:40.442 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.443 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 132.18228557399999, 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.444 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:40.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:40.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:40.450 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.464062681999998, 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:40.451 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:40.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:40.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.460935005000003, 2024-09-17T23:04:40.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:40.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:40.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.461 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.459085975999997, 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.462 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:40.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.457771895999997, 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.467 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:40.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.456199363000003, 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.472 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:40.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:40.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:40.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.217408210000002, 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:40.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:40.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.482 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.215914271000003, 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:40.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:40.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:40.488 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.213985547, 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:40.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:40.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.212087447999998, 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.494 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:40.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.498 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.211325047999999, 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:40.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.225958867000003, 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.225832052999998, 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.508 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 47.224051127999999, 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.513 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:40.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 22.218962869999999, 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:40.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:40.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 17.217959755999999, 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.522 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:04:40.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:04:40.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 12.217942892, 2024-09-17T23:04:40.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:04:40.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.530 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 7.2170316630000002, 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:40.531 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:04:40.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.535 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:40.536 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:40.537 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:40.534+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:40.637 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:40.635+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:40.679 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:40.679 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:40.679 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:40.679 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:40.688 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:40.772 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:40.770+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:40.832 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:40.832 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:40.832 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:40.832 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:40.832 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:40.839 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:40.837+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:40.840 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:40.940 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:40.938+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 63.022728727999997, 2024-09-17T23:04:40.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.985 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:40.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:40.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 63.017532248999999, 2024-09-17T23:04:40.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:40.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:40.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 63.014721121000001, 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.995 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:40.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.998 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.971088809999998, 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:40.999 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:41.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:41.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:41.003 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.970747690000003, 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:41.007 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.963347597000002, 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.008 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:41.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.828132877000002, 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:41.012 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:41.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.016 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.827831627999998, 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:41.017 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:41.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:41.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:41.021 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.777422829000002, 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.022 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:41.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:41.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.777106156000002, 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.026 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:41.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.030 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.770065739000003, 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:41.031 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.769789371999998, 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.035 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:41.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:41.039 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 62.766506135, 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:41.040 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:41.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:41.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:41.044 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:41.044 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.044 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.044 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.044 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:41.044 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:41.044 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:41.045 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:41.043+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:41.046 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:41.146 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:41.144+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:41.155 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:41.155 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:41.155 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:41.155 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:41.164 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:41.246 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:41.244+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:41.270 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:41.271 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:41.271 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:41.271 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:41.271 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:41.280 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:41.319 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:04:41.347 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:41.345+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:41.428 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.428 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 140.004566463, 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:41.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:41.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 140.004119551, 2024-09-17T23:04:41.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:41.434 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.436 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.437 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.98744091, 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:41.439 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:41.440 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.98688723999999, 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:41.442 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:41.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.986275616, 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:41.447 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:41.448 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.451 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.985622917, 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.452 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.455 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.98508677699999, 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:41.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:41.460 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.97028358, 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.461 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.463 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.464 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.96994089699999, 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.465 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.467 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:41.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.96937151200001, 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:41.469 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.96689132899999, 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.474 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:41.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.95938786299999, 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.478 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:41.481 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.95888641799999, 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:41.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.486 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.956250697, 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.487 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:41.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.491 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.94839302599999, 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:41.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:41.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.495 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:41.496 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.81028720200001, 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.497 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.498 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.499 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.500 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 139.39947041600001, 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.501 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.502 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:41.503 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.504 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.505 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 138.89563692300001, 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.506 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.507 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.508 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.509 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:41.510 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 138.890235803, 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:41.511 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.512 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:41.513 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.514 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:41.515 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.462536954999997, 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:41.516 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.517 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.518 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:41.519 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.520 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.521 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.521 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.521 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.521 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:41.522 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:41.523 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:41.520+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:41.623 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:41.621+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:41.632 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:41.632 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:41.632 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:41.633 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:41.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:41.723 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:41.722+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:41.745 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:41.745 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:41.746 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:41.746 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:41.754 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:41.824 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:41.822+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:41.861 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:41.861 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 32.267130909000002, 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:41.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:41.865 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:41.870 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:41.925 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:41.922+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:41.982 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:41.982 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:41.982 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:41.982 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:41.992 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:42.026 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:42.024+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:42.096 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:42.096 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:42.097 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:42.097 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:42.097 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:42.099 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:42.104 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:42.143 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:42.141+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:42.207 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:42.207 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:42.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:42.207 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:42.207 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:42.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:42.223 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:42.224 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:42.241 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:42.241 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:42.258 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:42.258 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:42.260 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:42.258+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:42.275 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:42.275 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:42.291 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:42.292 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:42.295 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:42.296 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:42.320 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:42.320 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:42.328 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:42.326+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:42.330 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:42.429 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:42.429 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:42.429 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-17T23:04:42.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T23:04:42.430 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:42.427+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:42.473 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:42.473 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:42.482 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:42.530 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:42.528+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:42.585 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:42.585 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:42.594 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:42.636 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:42.633+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:42.720 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 73, 2024-09-17T23:04:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "4cb0491c-5273-43ce-9711-0f68bec58f2e", 2024-09-17T23:04:42.720 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-09-17T23:02:05.418126+0000", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-09-17T23:04:41.314153+0000", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "last_up_change": "2024-09-17T23:03:42.411787+0000", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "last_in_change": "2024-09-17T23:03:01.271643+0000", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_num": 5804032, 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_set": [ 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nodeep-scrub", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "pglog_hardlimit", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "purged_snapdirs", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_deletes", 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "sortbitwise" 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_version": 4, 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T23:04:42.721 INFO:teuthology.orchestra.run.smithi005.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_snapshot": "", 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_max": 2, 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd": 8, 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "require_min_compat_client": "luminous", 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "min_compat_client": "luminous", 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "require_osd_release": "squid", 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_crimson": false, 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": [ 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 1, 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": ".mgr", 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:19.615759+0000", 2024-09-17T23:04:42.722 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool", 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 1, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 1, 2024-09-17T23:04:42.723 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 1, 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 1, 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 1, 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "17", 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:04:42.724 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 0, 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 0, 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:04:42.725 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:04:42.726 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "options": { 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_max": 32, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_min": 1 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": {} 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.727 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 7.690000057220459, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 7.690000057220459, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 1, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 1, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 0.99012374877929688, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 0.99000000953674316, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 0.99000000953674316 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 2, 2024-09-17T23:04:42.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": "rbd", 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:24.412869+0000", 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 8193, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:04:42.729 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 8, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 8, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 8, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 8, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 8, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:04:42.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "21", 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 2, 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 21, 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:04:42.731 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:04:42.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "options": {}, 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:04:42.733 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd": {} 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable", 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 0, 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 0 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "69fa22ee-5c14-4f80-82fe-b22939183e4a", 2024-09-17T23:04:42.734 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6802", 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6803", 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:42.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6806", 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6807", 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:42.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6804", 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6805", 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.739 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6801/3261733059", 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6803/3261733059", 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6807/3261733059", 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6805/3261733059", 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "a50256db-895f-4a6b-b83e-e251a3b53e10", 2024-09-17T23:04:42.740 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 0.920989990234375, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 18, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 22, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6816", 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6817", 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6818", 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6819", 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6822", 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6823", 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6820", 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6821", 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6817/3745424715", 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6819/3745424715", 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6823/3745424715", 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6821/3745424715", 2024-09-17T23:04:42.745 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2", 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:42.746 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 36, 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 50, 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6824", 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6825", 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:42.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6826", 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6827", 2024-09-17T23:04:42.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6830", 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6831", 2024-09-17T23:04:42.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6828", 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6829", 2024-09-17T23:04:42.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6825/3492189306", 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6827/3492189306", 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6831/3492189306", 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6829/3492189306", 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "b9664ac0-db52-42bb-aa10-9ad23cc7021a", 2024-09-17T23:04:42.751 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6808", 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6809", 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6810", 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6811", 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6814", 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:42.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6815", 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6812", 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:42.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6813", 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6809/1475101831", 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6811/1475101831", 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6815/1475101831", 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6813/1475101831", 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:42.756 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "5a11b2ff-7a67-40ed-8076-90ce187a3d96", 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:42.757 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 58, 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6810", 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6811", 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6812", 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6813", 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6816", 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6817", 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6814", 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6815", 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.761 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6811/1406375140", 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6813/1406375140", 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6817/1406375140", 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6815/1406375140", 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "2361e4e6-f10b-417b-a976-a037ac890e11", 2024-09-17T23:04:42.762 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6818", 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6819", 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6820", 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6821", 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6824", 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6825", 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6822", 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6823", 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6819/2095030613", 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6821/2095030613", 2024-09-17T23:04:42.767 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6825/2095030613", 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6823/2095030613", 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "8d3a457f-9981-4307-ac8e-4d45f1600ade", 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:42.768 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 39, 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6802", 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6803", 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6804", 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6805", 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6808", 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6809", 2024-09-17T23:04:42.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6806", 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6807", 2024-09-17T23:04:42.772 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6803/3030792595", 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6805/3030792595", 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6809/3030792595", 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6807/3030792595", 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3", 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 39, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:42.774 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6826", 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6827", 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.775 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6828", 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6829", 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:42.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6832", 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6833", 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:42.777 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6830", 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6831", 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:42.778 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6827/967279289", 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6829/967279289", 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6833/967279289", 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6831/967279289", 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_xinfo": [ 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:04:42.779 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.899917+0000", 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:42.780 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.157860+0000", 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 22 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.416164+0000", 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 50 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.781 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.907974+0000", 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:42.782 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.523463+0000", 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.326314+0000", 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:04:42.783 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.363775+0000", 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:42.784 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.492325+0000", 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 39 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap": [ 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.5", 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: 0 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.7", 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: 4 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_items": [], 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_primaries": [], 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_temp": [ 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.7", 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:42.786 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: 6 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_temp": [], 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklist": {}, 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "range_blocklist": {}, 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profiles": { 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "default": { 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-failure-domain": "osd", 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "k": "2", 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "m": "1", 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin": "jerasure", 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: "technique": "reed_sol_van" 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps_queue": [], 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "new_removed_snaps": [], 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "new_purged_snaps": [], 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_node_flags": {}, 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "device_class_flags": {}, 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": { 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_enabled": false, 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_bucket_count": 0, 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "degraded_stretch_mode": 0, 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "recovering_stretch_mode": 0, 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_bucket": 0 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:42.788 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:42.790 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:42.790 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:42.791 INFO:tasks.thrashosds.thrasher:j is {'epoch': 73, 'fsid': '4cb0491c-5273-43ce-9711-0f68bec58f2e', 'created': '2024-09-17T23:02:05.418126+0000', 'modified': '2024-09-17T23:04:41.314153+0000', 'last_up_change': '2024-09-17T23:03:42.411787+0000', 'last_in_change': '2024-09-17T23:03:01.271643+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T23:02:19.615759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.9901237487792969, 'average_primary_affinity': 0.9900000095367432, 'average_primary_affinity_weighted': 0.9900000095367432}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T23:02:24.412869+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '69fa22ee-5c14-4f80-82fe-b22939183e4a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6800', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6801', 'nonce': 3261733059}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6802', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6803', 'nonce': 3261733059}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6806', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6807', 'nonce': 3261733059}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6804', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6805', 'nonce': 3261733059}]}, 'public_addr': '172.21.15.5:6801/3261733059', 'cluster_addr': '172.21.15.5:6803/3261733059', 'heartbeat_back_addr': '172.21.15.5:6807/3261733059', 'heartbeat_front_addr': '172.21.15.5:6805/3261733059', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a50256db-895f-4a6b-b83e-e251a3b53e10', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.920989990234375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 22, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6816', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6817', 'nonce': 3745424715}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6818', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6819', 'nonce': 3745424715}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6822', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6823', 'nonce': 3745424715}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6820', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6821', 'nonce': 3745424715}]}, 'public_addr': '172.21.15.5:6817/3745424715', 'cluster_addr': '172.21.15.5:6819/3745424715', 'heartbeat_back_addr': '172.21.15.5:6823/3745424715', 'heartbeat_front_addr': '172.21.15.5:6821/3745424715', 'state': ['exists']}, {'osd': 2, 'uuid': 'c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 36, 'down_at': 50, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6824', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6825', 'nonce': 3492189306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6826', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6827', 'nonce': 3492189306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6830', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6831', 'nonce': 3492189306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6828', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6829', 'nonce': 3492189306}]}, 'public_addr': '172.21.15.5:6825/3492189306', 'cluster_addr': '172.21.15.5:6827/3492189306', 'heartbeat_back_addr': '172.21.15.5:6831/3492189306', 'heartbeat_front_addr': '172.21.15.5:6829/3492189306', 'state': ['exists']}, {'osd': 3, 'uuid': 'b9664ac0-db52-42bb-aa10-9ad23cc7021a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6808', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6809', 'nonce': 1475101831}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6810', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6811', 'nonce': 1475101831}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6814', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6815', 'nonce': 1475101831}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6812', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6813', 'nonce': 1475101831}]}, 'public_addr': '172.21.15.5:6809/1475101831', 'cluster_addr': '172.21.15.5:6811/1475101831', 'heartbeat_back_addr': '172.21.15.5:6815/1475101831', 'heartbeat_front_addr': '172.21.15.5:6813/1475101831', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5a11b2ff-7a67-40ed-8076-90ce187a3d96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 58, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6810', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6811', 'nonce': 1406375140}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6812', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6813', 'nonce': 1406375140}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6816', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6817', 'nonce': 1406375140}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6814', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6815', 'nonce': 1406375140}]}, 'public_addr': '172.21.15.152:6811/1406375140', 'cluster_addr': '172.21.15.152:6813/1406375140', 'heartbeat_back_addr': '172.21.15.152:6817/1406375140', 'heartbeat_front_addr': '172.21.15.152:6815/1406375140', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2361e4e6-f10b-417b-a976-a037ac890e11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6818', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6819', 'nonce': 2095030613}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6820', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6821', 'nonce': 2095030613}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6824', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6825', 'nonce': 2095030613}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6822', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6823', 'nonce': 2095030613}]}, 'public_addr': '172.21.15.152:6819/2095030613', 'cluster_addr': '172.21.15.152:6821/2095030613', 'heartbeat_back_addr': '172.21.15.152:6825/2095030613', 'heartbeat_front_addr': '172.21.15.152:6823/2095030613', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8d3a457f-9981-4307-ac8e-4d45f1600ade', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6802', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6803', 'nonce': 3030792595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6804', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6805', 'nonce': 3030792595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6808', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6809', 'nonce': 3030792595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6806', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6807', 'nonce': 3030792595}]}, 'public_addr': '172.21.15.152:6803/3030792595', 'cluster_addr': '172.21.15.152:6805/3030792595', 'heartbeat_back_addr': '172.21.15.152:6809/3030792595', 'heartbeat_front_addr': '172.21.15.152:6807/3030792595', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 39, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6826', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6827', 'nonce': 967279289}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6828', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6829', 'nonce': 967279289}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 967279289}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6830', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6831', 'nonce': 967279289}]}, 'public_addr': '172.21.15.152:6827/967279289', 'cluster_addr': '172.21.15.152:6829/967279289', 'heartbeat_back_addr': '172.21.15.152:6833/967279289', 'heartbeat_front_addr': '172.21.15.152:6831/967279289', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.899917+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.157860+0000', 'dead_epoch': 22}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.416164+0000', 'dead_epoch': 50}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.907974+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.523463+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.326314+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.363775+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.492325+0000', 'dead_epoch': 39}], 'pg_upmap': [{'pgid': '2.5', 'osds': [2, 0]}, {'pgid': '2.7', 'osds': [7, 4]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '2.7', 'osds': [4, 6]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T23:04:42.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:04:42.791 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:42.792 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:42.788+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:42.890 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:42.888+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:42.935 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:42.935 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:42.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:42.991 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:42.988+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:43.079 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:43.080 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:04:43.087 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:43.087 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:43.091 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:43.089+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:43.092 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-17T23:04:41.595560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590403,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":227,"num_read_kb":191,"num_write":176,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":9,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239224,"kb_used_data":6360,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735496,"statfs":{"total":773094113280,"available":772849147904,"internally_reserved":0,"allocated":6512640,"data_stored":3358388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.294511"},"pg_stats":[{"pgid":"2.7","version":"47'1","reported_seq":37,"reported_epoch":72,"state":"active+clean+remapped","last_fresh":"2024-09-17T23:04:38.350208+0000","last_change":"2024-09-17T23:04:01.218012+0000","last_active":"2024-09-17T23:04:38.350208+0000","last_peered":"2024-09-17T23:04:38.350208+0000","last_clean":"2024-09-17T23:04:38.350208+0000","last_became_active":"2024-09-17T23:04:01.217571+0000","last_became_peered":"2024-09-17T23:04:01.217571+0000","last_unstale":"2024-09-17T23:04:38.350208+0000","last_undegraded":"2024-09-17T23:04:38.350208+0000","last_fullsized":"2024-09-17T23:04:38.350208+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:00:08.739125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"47'1","reported_seq":113,"reported_epoch":72,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:38.350207+0000","last_change":"2024-09-17T23:03:38.010425+0000","last_active":"2024-09-17T23:04:38.350207+0000","last_peered":"2024-09-17T23:04:38.350207+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.206501+0000","last_became_peered":"2024-09-17T23:02:36.206501+0000","last_unstale":"2024-09-17T23:04:38.350207+0000","last_undegraded":"2024-09-17T23:03:37.965028+0000","last_fullsized":"2024-09-17T23:02:36.205957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:14:38.209826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":1}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":52,"reported_epoch":72,"state":"active+undersized","last_fresh":"2024-09-17T23:04:38.310426+0000","last_change":"2024-09-17T23:03:43.419919+0000","last_active":"2024-09-17T23:04:38.310426+0000","last_peered":"2024-09-17T23:04:38.310426+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:03:43.419919+0000","last_became_peered":"2024-09-17T23:03:43.419919+0000","last_unstale":"2024-09-17T23:04:38.310426+0000","last_undegraded":"2024-09-17T23:04:38.310426+0000","last_fullsized":"2024-09-17T23:03:43.419336+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:10.447292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"47'2","reported_seq":108,"reported_epoch":72,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:38.310423+0000","last_change":"2024-09-17T23:03:38.216030+0000","last_active":"2024-09-17T23:04:38.310423+0000","last_peered":"2024-09-17T23:04:38.310423+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.205932+0000","last_became_peered":"2024-09-17T23:02:36.205932+0000","last_unstale":"2024-09-17T23:04:38.310423+0000","last_undegraded":"2024-09-17T23:03:37.963691+0000","last_fullsized":"2024-09-17T23:02:36.205433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:27.219119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"47'7","reported_seq":147,"reported_epoch":72,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:38.310989+0000","last_change":"2024-09-17T23:02:36.206690+0000","last_active":"2024-09-17T23:04:38.310989+0000","last_peered":"2024-09-17T23:04:38.310989+0000","last_clean":"2024-09-17T23:02:28.601103+0000","last_became_active":"2024-09-17T23:02:36.206690+0000","last_became_peered":"2024-09-17T23:02:36.206690+0000","last_unstale":"2024-09-17T23:04:38.310989+0000","last_undegraded":"2024-09-17T23:02:36.206032+0000","last_fullsized":"2024-09-17T23:02:36.205941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:18.666349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":50,"reported_epoch":72,"state":"active+undersized","last_fresh":"2024-09-17T23:04:38.310391+0000","last_change":"2024-09-17T23:03:43.419931+0000","last_active":"2024-09-17T23:04:38.310391+0000","last_peered":"2024-09-17T23:04:38.310391+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:03:43.419931+0000","last_became_peered":"2024-09-17T23:03:43.419931+0000","last_unstale":"2024-09-17T23:04:38.310391+0000","last_undegraded":"2024-09-17T23:04:38.310391+0000","last_fullsized":"2024-09-17T23:03:43.419324+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:37.122490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"stale+active+undersized","last_fresh":"2024-09-17T23:03:08.303154+0000","last_change":"2024-09-17T23:02:36.204438+0000","last_active":"2024-09-17T23:03:08.303154+0000","last_peered":"2024-09-17T23:03:08.303154+0000","last_clean":"2024-09-17T23:02:28.597949+0000","last_became_active":"2024-09-17T23:02:36.204438+0000","last_became_peered":"2024-09-17T23:02:36.204438+0000","last_unstale":"2024-09-17T23:03:14.328698+0000","last_undegraded":"2024-09-17T23:03:08.303154+0000","last_fullsized":"2024-09-17T23:02:36.203989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:29:19.022828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"51'6","reported_seq":169,"reported_epoch":72,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:38.310988+0000","last_change":"2024-09-17T23:03:43.423198+0000","last_active":"2024-09-17T23:04:38.310988+0000","last_peered":"2024-09-17T23:04:38.310988+0000","last_clean":"2024-09-17T23:03:42.574324+0000","last_became_active":"2024-09-17T23:03:43.423198+0000","last_became_peered":"2024-09-17T23:03:43.423198+0000","last_unstale":"2024-09-17T23:04:38.310988+0000","last_undegraded":"2024-09-17T23:03:43.422693+0000","last_fullsized":"2024-09-17T23:03:43.422600+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:45:54.029051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":72,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:38.310396+0000","last_change":"2024-09-17T23:03:15.332337+0000","last_active":"2024-09-17T23:04:38.310396+0000","last_peered":"2024-09-17T23:04:38.310396+0000","last_clean":"2024-09-17T23:02:22.544336+0000","last_became_active":"2024-09-17T23:03:15.332337+0000","last_became_peered":"2024-09-17T23:03:15.332337+0000","last_unstale":"2024-09-17T23:04:38.310396+0000","last_undegraded":"2024-09-17T23:03:15.331270+0000","last_fullsized":"2024-09-17T23:03:15.331175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:02:33.805222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":91,"num_write":17,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":8,"acting":9,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":745489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":346779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":346782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":346763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":831488,"data_stored":346763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":215095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1425408,"data_stored":937131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:04:43.093 INFO:tasks.thrashosds.thrasher:Setting 2.1 to [6, 5, 7, 1] 2024-09-17T23:04:43.093 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '2.1', '6', '5', '7', '1'] 2024-09-17T23:04:43.093 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 2.1 6 5 7 1 2024-09-17T23:04:43.096 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:43.193 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:43.191+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:43.241 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:43.241 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:43.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:43.293 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:43.292+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:43.334 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:04:43.362 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:43.362 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:43.371 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:43.394 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:43.392+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:43.495 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:43.493+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:43.521 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:43.522 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:43.533 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:43.596 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:43.594+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:43.640 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:43.640 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:43.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:43.696 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:43.694+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:43.756 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:43.756 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:43.765 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:43.797 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:43.795+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:43.872 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:43.872 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:43.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:43.924 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:43.922+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:43.985 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:43.985 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:43.994 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:44.035 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:44.033+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:44.098 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:44.096+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:44.138 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:44.138 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:44.147 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:44.232 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:44.230+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:44.291 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:44.291 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:44.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:44.300 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:44.300 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:44.297+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:44.330 INFO:teuthology.orchestra.run.smithi005.stderr:set 2.1 pg_upmap_items mapping to [6->5,7->1] 2024-09-17T23:04:44.333 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:04:44.401 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:44.399+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:44.425 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:44.426 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:44.443 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:44.443 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:44.446 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:44.446 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:44.455 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:44.460 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:44.461 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:44.477 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:44.477 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:44.493 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:44.494 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:44.497 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:44.497 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:44.501 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:44.499+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:44.599 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:44.599 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:44.599 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:44.599 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:44.600 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:44.603 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:44.601+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:44.608 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:44.704 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:44.702+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:44.755 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:44.755 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 138.51568729499999, 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.756 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.757 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:44.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.762 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:44.763 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 137.51418533200001, 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:44.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:44.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:44.769 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 136.50831040700001, 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:44.770 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:44.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:44.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:44.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:44.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.790087514999996, 2024-09-17T23:04:44.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:44.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:44.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:44.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.782 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.786959838000001, 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:44.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:44.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.785110809000003, 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:44.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:44.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.783796729000002, 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.795 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:44.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:44.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.799 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:44.800 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.782224196000001, 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:44.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:44.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:44.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.807 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.543433042999993, 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:44.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:44.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:44.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.541939103999994, 2024-09-17T23:04:44.814 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.815 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:44.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.540010379999998, 2024-09-17T23:04:44.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:44.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:44.823 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.824 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:44.825 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.538112280999997, 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.826 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:44.827 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.828 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.829 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.830 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:44.831 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.537349880999997, 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.832 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:44.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:44.836 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 61.551983700000001, 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:44.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:44.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 61.551856886000003, 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.842 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.846 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 51.550075960999997, 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.847 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:44.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.851 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 26.544987703, 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.852 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:44.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.857 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 21.543984589000001, 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:04:44.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 16.543967725000002, 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.862 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:44.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.865 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:44.866 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 11.543056496, 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:04:44.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:44.870 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:44.872 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:44.872 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:44.869+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:44.973 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:44.971+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:45.016 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:45.016 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:45.016 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:45.024 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:45.074 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:45.072+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:45.126 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:45.126 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:45.126 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:45.126 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:45.126 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:45.135 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:45.179 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:45.177+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:45.239 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:45.239 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.278469817000001, 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:45.240 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.241 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:45.242 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:45.243 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.273273337999996, 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:45.244 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:45.245 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.246 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:45.247 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.248 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.270462210000005, 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.249 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:45.250 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:45.251 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:45.252 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.226829898999995, 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.253 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.254 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.255 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.256 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.226488778999993, 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.257 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.258 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.259 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:45.260 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.219088686000006, 2024-09-17T23:04:45.261 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.262 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.263 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:45.264 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.265 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.083873965999999, 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:45.266 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.267 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:45.268 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:45.269 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:45.270 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.083572716999996, 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:45.271 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.273 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.274 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.033163918, 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:45.275 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.032847244999999, 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:45.279 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:45.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:45.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.025806828, 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:45.283 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:45.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.025530461000002, 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:45.287 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:45.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:45.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 67.022247223999997, 2024-09-17T23:04:45.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:45.295 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:45.296 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:45.295+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:45.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:45.398 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:45.396+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:45.417 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:45.417 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:45.417 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:45.417 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:45.426 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:45.510 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:45.508+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:45.574 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:45.574 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:45.574 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:45.574 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:45.574 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:45.583 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:45.624 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:45.622+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:45.700 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:45.698+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.30899621500001, 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.733 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.734 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.735 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.736 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.30854930300001, 2024-09-17T23:04:45.737 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.739 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:45.741 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.29187066200001, 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:45.742 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.743 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.744 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.29131699199999, 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:45.746 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.747 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.748 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.290705368, 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.751 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.752 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:45.753 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.290052669, 2024-09-17T23:04:45.754 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.755 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.756 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.757 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:45.758 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.289516529, 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:45.760 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:45.761 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.762 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.274713332, 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.763 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.764 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.765 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.27437064899999, 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.767 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:45.768 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.769 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:45.770 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.27380126400001, 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.771 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.772 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.773 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.774 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.271321081, 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.775 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:45.776 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:45.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.26381761499999, 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.779 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:45.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:45.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.26331617, 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.783 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.26068044900001, 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.787 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.252822778, 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.791 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:45.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 144.11471695399999, 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.795 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:45.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:45.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:45.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 143.70390016799999, 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.799 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:45.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:45.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 143.20006667499999, 2024-09-17T23:04:45.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 143.194665555, 2024-09-17T23:04:45.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 67.766966706999995, 2024-09-17T23:04:45.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:45.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:45.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:45.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:45.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.816 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.816 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:45.816 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:45.816 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:45.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:45.818 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:45.815+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:45.918 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:45.916+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:45.965 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:45.965 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:45.965 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:45.965 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:45.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:46.018 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:46.017+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:46.119 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:46.117+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:46.121 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:46.121 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:46.121 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:46.121 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:46.121 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:46.130 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:46.220 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:46.218+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:46.236 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 36.642548755999997, 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:46.237 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:46.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:46.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:46.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:46.241 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:46.241 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:46.245 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:46.321 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:46.319+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:46.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:04:46.361 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:46.361 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:46.361 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:46.361 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:46.370 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:46.422 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:46.420+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:46.474 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:46.474 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:46.474 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:46.474 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:46.474 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:46.483 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:46.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:46.542 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:46.540+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:46.587 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:46.587 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:46.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:46.587 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:46.587 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:46.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:46.623 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:46.624 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:46.624 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:46.621+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:46.624 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:46.624 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:46.641 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:46.641 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:46.658 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:46.658 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:46.675 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:46.675 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:46.692 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:46.692 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:46.696 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:46.696 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:46.701 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:46.701 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:46.710 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:46.753 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:46.751+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:46.812 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:46.813 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:46.821 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:46.862 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:46.860+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:46.925 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:46.923+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:46.965 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:46.965 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:46.973 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:47.026 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:47.024+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:47.077 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:47.078 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:47.086 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:47.127 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:47.125+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:47.227 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:47.225+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:47.229 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:47.229 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:47.238 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:47.329 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:47.327+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:47.333 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:04:47.342 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:47.342 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:47.352 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:47.430 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:47.428+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:47.506 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:47.507 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:47.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:47.560 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:47.558+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:47.623 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:47.624 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:47.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:47.633 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:47.630+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:47.733 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:47.731+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:47.779 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:47.779 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:47.788 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:47.872 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:47.870+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:47.935 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:47.935 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:47.935 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:47.933+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:47.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:48.036 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:48.034+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:48.091 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:48.091 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:48.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:48.144 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:48.142+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:48.207 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:48.207 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:48.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:48.261 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:48.259+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:48.328 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:48.328 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:48.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:48.339 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:48.336+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:48.440 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:48.438+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:48.484 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:48.484 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:48.493 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:48.541 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:48.539+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:48.636 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:48.636 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:48.641 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:48.639+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:48.645 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:48.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:48.743 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:48.740+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:48.789 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:48.789 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:48.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:48.824 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:48.824 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:48.841 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:48.841 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:48.858 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:48.858 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:48.874 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:48.875 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:48.880 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:48.878+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:48.892 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:48.893 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:48.893 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:48.896 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:48.897 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:48.942 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:48.942 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:48.942 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:48.944 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:48.942+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:48.950 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:49.045 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:49.043+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:49.096 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:49.096 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:49.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:49.096 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:49.096 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.096 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:49.096 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 142.856445767, 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:49.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:49.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 141.85494380399999, 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.103 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:49.109 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 140.84906887899999, 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:49.110 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:49.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.130845987000001, 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.117 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:49.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:49.120 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.127718310000006, 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:49.121 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:49.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.126 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.125869281000007, 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:49.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.124555201000007, 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.122982668000006, 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:49.137 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:49.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:49.141 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 70.884191514999998, 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.142 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:49.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:49.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 70.882697575999998, 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 70.880768852000003, 2024-09-17T23:04:49.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.155 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 70.878870753000001, 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.159 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.163 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 70.878108353000002, 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.164 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 65.892742171999998, 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:49.168 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:49.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:49.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.173 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 65.892615358, 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:49.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.176 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:49.178 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 55.890834433000002, 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:49.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:49.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.885746175000001, 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.183 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.187 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.884743061000002, 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:04:49.188 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:04:49.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.884726196999999, 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.193 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:04:49.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 15.883814967999999, 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.197 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.201 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:49.203 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:49.203 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:49.200+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:49.303 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:49.301+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:49.347 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:49.348 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:49.348 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T23:04:49.348 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T23:04:49.348 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:49.349 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:49.349 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:49.349 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:49.351 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:04:49.357 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:49.435 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:49.433+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:49.501 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:49.501 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:49.501 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:49.501 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:49.501 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:49.504 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:49.502+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:49.510 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:49.605 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:49.603+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.652881534000002, 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:49.614 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:49.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.647685054999997, 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:49.619 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:49.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:49.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.644873927000006, 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.624 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.628 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.601241615999996, 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.629 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.600900495999994, 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.633 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:49.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:49.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.637 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.593500402999993, 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:49.638 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:49.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.458285683, 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:49.642 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:49.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.646 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.457984433999997, 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:49.647 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.407575635000001, 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.651 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:49.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:49.655 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.407258962, 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:49.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.659 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.400218545000001, 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:49.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:49.664 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.399942178000003, 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 71.396658940999998, 2024-09-17T23:04:49.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:49.672 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:49.674 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:49.674 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:49.674 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 75, 2024-09-17T23:04:49.674 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "4cb0491c-5273-43ce-9711-0f68bec58f2e", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-09-17T23:02:05.418126+0000", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-09-17T23:04:47.327730+0000", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "last_up_change": "2024-09-17T23:03:42.411787+0000", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "last_in_change": "2024-09-17T23:03:01.271643+0000", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_num": 5801984, 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_set": [ 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "noscrub", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "pglog_hardlimit", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "purged_snapdirs", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_deletes", 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "sortbitwise" 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_version": 4, 2024-09-17T23:04:49.675 INFO:teuthology.orchestra.run.smithi005.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_snapshot": "", 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_max": 2, 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd": 8, 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "require_min_compat_client": "luminous", 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "min_compat_client": "luminous", 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "require_osd_release": "squid", 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_crimson": false, 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": [ 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 1, 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": ".mgr", 2024-09-17T23:04:49.676 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:19.615759+0000", 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool", 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 1, 2024-09-17T23:04:49.677 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 1, 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 1, 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 1, 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 1, 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "17", 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:04:49.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 0, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 0, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:04:49.679 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:04:49.680 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "options": { 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_max": 32, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_min": 1 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": {} 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.681 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 7.690000057220459, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 7.690000057220459, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 1, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 1, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 0.99012374877929688, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 0.99000000953674316, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 0.99000000953674316 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 2, 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": "rbd", 2024-09-17T23:04:49.682 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:24.412869+0000", 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 8193, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 8, 2024-09-17T23:04:49.683 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 8, 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 8, 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 8, 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 8, 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "21", 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:04:49.684 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 2, 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 21, 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:04:49.685 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:04:49.686 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "options": {}, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd": {} 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable", 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 0, 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 0 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.687 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "69fa22ee-5c14-4f80-82fe-b22939183e4a", 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:49.688 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6802", 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6803", 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6806", 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6807", 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.691 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6804", 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6805", 2024-09-17T23:04:49.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6801/3261733059", 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6803/3261733059", 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6807/3261733059", 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6805/3261733059", 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.693 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "a50256db-895f-4a6b-b83e-e251a3b53e10", 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 0.920989990234375, 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:49.694 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 18, 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 22, 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6816", 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:49.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6817", 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6818", 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:49.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6819", 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6822", 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6823", 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6820", 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6821", 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6817/3745424715", 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6819/3745424715", 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6823/3745424715", 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6821/3745424715", 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.700 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2", 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 36, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 50, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6824", 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6825", 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6826", 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6827", 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6830", 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6831", 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6828", 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6829", 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6825/3492189306", 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6827/3492189306", 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6831/3492189306", 2024-09-17T23:04:49.705 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6829/3492189306", 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "b9664ac0-db52-42bb-aa10-9ad23cc7021a", 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:49.706 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6808", 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6809", 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6810", 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6811", 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.708 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6814", 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6815", 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.709 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6812", 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6813", 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.710 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6809/1475101831", 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6811/1475101831", 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6815/1475101831", 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6813/1475101831", 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "5a11b2ff-7a67-40ed-8076-90ce187a3d96", 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:49.711 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 58, 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6810", 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6811", 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6812", 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6813", 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6816", 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6817", 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6814", 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6815", 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6811/1406375140", 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6813/1406375140", 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6817/1406375140", 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6815/1406375140", 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.716 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "2361e4e6-f10b-417b-a976-a037ac890e11", 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6818", 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6819", 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6820", 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6821", 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6824", 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:49.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6825", 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6822", 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:49.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6823", 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6819/2095030613", 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6821/2095030613", 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6825/2095030613", 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6823/2095030613", 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:49.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "8d3a457f-9981-4307-ac8e-4d45f1600ade", 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 39, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:49.722 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6802", 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6803", 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:49.723 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6804", 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6805", 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.724 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6808", 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6809", 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.725 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6806", 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6807", 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:49.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6803/3030792595", 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6805/3030792595", 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6809/3030792595", 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6807/3030792595", 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.727 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3", 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 39, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:49.728 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6826", 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6827", 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.729 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6828", 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6829", 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.730 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6832", 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6833", 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.731 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6830", 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6831", 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:49.732 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6827/967279289", 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6829/967279289", 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6833/967279289", 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6831/967279289", 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_xinfo": [ 2024-09-17T23:04:49.733 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.899917+0000", 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:49.734 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.157860+0000", 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 22 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:49.735 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.416164+0000", 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 50 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.907974+0000", 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.736 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.523463+0000", 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:49.737 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.326314+0000", 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.363775+0000", 2024-09-17T23:04:49.738 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.492325+0000", 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 39 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap": [ 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.739 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.5", 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: 0 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.7", 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: 4 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:49.740 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_items": [], 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_primaries": [], 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_temp": [ 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.7", 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: 6 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_temp": [], 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklist": {}, 2024-09-17T23:04:49.741 INFO:teuthology.orchestra.run.smithi005.stdout: "range_blocklist": {}, 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profiles": { 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "default": { 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-failure-domain": "osd", 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "k": "2", 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "m": "1", 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin": "jerasure", 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "technique": "reed_sol_van" 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps_queue": [], 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "new_removed_snaps": [], 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "new_purged_snaps": [], 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_node_flags": {}, 2024-09-17T23:04:49.742 INFO:teuthology.orchestra.run.smithi005.stdout: "device_class_flags": {}, 2024-09-17T23:04:49.743 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": { 2024-09-17T23:04:49.743 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_enabled": false, 2024-09-17T23:04:49.743 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_bucket_count": 0, 2024-09-17T23:04:49.743 INFO:teuthology.orchestra.run.smithi005.stdout: "degraded_stretch_mode": 0, 2024-09-17T23:04:49.743 INFO:teuthology.orchestra.run.smithi005.stdout: "recovering_stretch_mode": 0, 2024-09-17T23:04:49.743 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_bucket": 0 2024-09-17T23:04:49.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:49.743 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:49.743 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:49.745 INFO:tasks.thrashosds.thrasher:j is {'epoch': 75, 'fsid': '4cb0491c-5273-43ce-9711-0f68bec58f2e', 'created': '2024-09-17T23:02:05.418126+0000', 'modified': '2024-09-17T23:04:47.327730+0000', 'last_up_change': '2024-09-17T23:03:42.411787+0000', 'last_in_change': '2024-09-17T23:03:01.271643+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T23:02:19.615759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.9901237487792969, 'average_primary_affinity': 0.9900000095367432, 'average_primary_affinity_weighted': 0.9900000095367432}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T23:02:24.412869+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '69fa22ee-5c14-4f80-82fe-b22939183e4a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6800', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6801', 'nonce': 3261733059}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6802', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6803', 'nonce': 3261733059}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6806', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6807', 'nonce': 3261733059}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6804', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6805', 'nonce': 3261733059}]}, 'public_addr': '172.21.15.5:6801/3261733059', 'cluster_addr': '172.21.15.5:6803/3261733059', 'heartbeat_back_addr': '172.21.15.5:6807/3261733059', 'heartbeat_front_addr': '172.21.15.5:6805/3261733059', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a50256db-895f-4a6b-b83e-e251a3b53e10', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.920989990234375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 22, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6816', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6817', 'nonce': 3745424715}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6818', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6819', 'nonce': 3745424715}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6822', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6823', 'nonce': 3745424715}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6820', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6821', 'nonce': 3745424715}]}, 'public_addr': '172.21.15.5:6817/3745424715', 'cluster_addr': '172.21.15.5:6819/3745424715', 'heartbeat_back_addr': '172.21.15.5:6823/3745424715', 'heartbeat_front_addr': '172.21.15.5:6821/3745424715', 'state': ['exists']}, {'osd': 2, 'uuid': 'c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 36, 'down_at': 50, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6824', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6825', 'nonce': 3492189306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6826', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6827', 'nonce': 3492189306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6830', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6831', 'nonce': 3492189306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6828', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6829', 'nonce': 3492189306}]}, 'public_addr': '172.21.15.5:6825/3492189306', 'cluster_addr': '172.21.15.5:6827/3492189306', 'heartbeat_back_addr': '172.21.15.5:6831/3492189306', 'heartbeat_front_addr': '172.21.15.5:6829/3492189306', 'state': ['exists']}, {'osd': 3, 'uuid': 'b9664ac0-db52-42bb-aa10-9ad23cc7021a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6808', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6809', 'nonce': 1475101831}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6810', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6811', 'nonce': 1475101831}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6814', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6815', 'nonce': 1475101831}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6812', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6813', 'nonce': 1475101831}]}, 'public_addr': '172.21.15.5:6809/1475101831', 'cluster_addr': '172.21.15.5:6811/1475101831', 'heartbeat_back_addr': '172.21.15.5:6815/1475101831', 'heartbeat_front_addr': '172.21.15.5:6813/1475101831', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5a11b2ff-7a67-40ed-8076-90ce187a3d96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 58, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6810', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6811', 'nonce': 1406375140}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6812', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6813', 'nonce': 1406375140}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6816', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6817', 'nonce': 1406375140}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6814', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6815', 'nonce': 1406375140}]}, 'public_addr': '172.21.15.152:6811/1406375140', 'cluster_addr': '172.21.15.152:6813/1406375140', 'heartbeat_back_addr': '172.21.15.152:6817/1406375140', 'heartbeat_front_addr': '172.21.15.152:6815/1406375140', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2361e4e6-f10b-417b-a976-a037ac890e11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6818', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6819', 'nonce': 2095030613}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6820', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6821', 'nonce': 2095030613}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6824', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6825', 'nonce': 2095030613}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6822', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6823', 'nonce': 2095030613}]}, 'public_addr': '172.21.15.152:6819/2095030613', 'cluster_addr': '172.21.15.152:6821/2095030613', 'heartbeat_back_addr': '172.21.15.152:6825/2095030613', 'heartbeat_front_addr': '172.21.15.152:6823/2095030613', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8d3a457f-9981-4307-ac8e-4d45f1600ade', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6802', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6803', 'nonce': 3030792595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6804', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6805', 'nonce': 3030792595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6808', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6809', 'nonce': 3030792595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6806', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6807', 'nonce': 3030792595}]}, 'public_addr': '172.21.15.152:6803/3030792595', 'cluster_addr': '172.21.15.152:6805/3030792595', 'heartbeat_back_addr': '172.21.15.152:6809/3030792595', 'heartbeat_front_addr': '172.21.15.152:6807/3030792595', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 39, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6826', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6827', 'nonce': 967279289}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6828', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6829', 'nonce': 967279289}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 967279289}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6830', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6831', 'nonce': 967279289}]}, 'public_addr': '172.21.15.152:6827/967279289', 'cluster_addr': '172.21.15.152:6829/967279289', 'heartbeat_back_addr': '172.21.15.152:6833/967279289', 'heartbeat_front_addr': '172.21.15.152:6831/967279289', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.899917+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.157860+0000', 'dead_epoch': 22}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.416164+0000', 'dead_epoch': 50}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.907974+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.523463+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.326314+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.363775+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.492325+0000', 'dead_epoch': 39}], 'pg_upmap': [{'pgid': '2.5', 'osds': [2, 0]}, {'pgid': '2.7', 'osds': [7, 4]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '2.7', 'osds': [4, 6]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T23:04:49.745 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:04:49.746 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:49.744+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:49.847 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:49.845+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:49.857 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:49.857 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:49.857 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:49.857 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:49.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:49.949 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:49.946+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:50.012 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:50.012 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:50.012 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:50.012 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:50.012 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:50.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:50.042 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:50.042 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:04:50.056 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-17T23:04:49.597337+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590403,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":227,"num_read_kb":191,"num_write":176,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":9,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239464,"kb_used_data":6600,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735256,"statfs":{"total":773094113280,"available":772848902144,"internally_reserved":0,"allocated":6758400,"data_stored":3469053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001777"},"pg_stats":[{"pgid":"2.7","version":"47'1","reported_seq":43,"reported_epoch":75,"state":"active+clean+remapped","last_fresh":"2024-09-17T23:04:47.728276+0000","last_change":"2024-09-17T23:04:01.218012+0000","last_active":"2024-09-17T23:04:47.728276+0000","last_peered":"2024-09-17T23:04:47.728276+0000","last_clean":"2024-09-17T23:04:47.728276+0000","last_became_active":"2024-09-17T23:04:01.217571+0000","last_became_peered":"2024-09-17T23:04:01.217571+0000","last_unstale":"2024-09-17T23:04:47.728276+0000","last_undegraded":"2024-09-17T23:04:47.728276+0000","last_fullsized":"2024-09-17T23:04:47.728276+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:00:08.739125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"47'1","reported_seq":120,"reported_epoch":75,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:47.334857+0000","last_change":"2024-09-17T23:03:38.010425+0000","last_active":"2024-09-17T23:04:47.334857+0000","last_peered":"2024-09-17T23:04:47.334857+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.206501+0000","last_became_peered":"2024-09-17T23:02:36.206501+0000","last_unstale":"2024-09-17T23:04:47.334857+0000","last_undegraded":"2024-09-17T23:03:37.965028+0000","last_fullsized":"2024-09-17T23:02:36.205957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:14:38.209826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":1}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":75,"state":"active+undersized","last_fresh":"2024-09-17T23:04:47.334210+0000","last_change":"2024-09-17T23:03:43.419919+0000","last_active":"2024-09-17T23:04:47.334210+0000","last_peered":"2024-09-17T23:04:47.334210+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:03:43.419919+0000","last_became_peered":"2024-09-17T23:03:43.419919+0000","last_unstale":"2024-09-17T23:04:47.334210+0000","last_undegraded":"2024-09-17T23:04:47.334210+0000","last_fullsized":"2024-09-17T23:03:43.419336+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:10.447292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"47'2","reported_seq":115,"reported_epoch":75,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:47.334204+0000","last_change":"2024-09-17T23:03:38.216030+0000","last_active":"2024-09-17T23:04:47.334204+0000","last_peered":"2024-09-17T23:04:47.334204+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.205932+0000","last_became_peered":"2024-09-17T23:02:36.205932+0000","last_unstale":"2024-09-17T23:04:47.334204+0000","last_undegraded":"2024-09-17T23:03:37.963691+0000","last_fullsized":"2024-09-17T23:02:36.205433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:27.219119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"47'7","reported_seq":153,"reported_epoch":75,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:47.728309+0000","last_change":"2024-09-17T23:02:36.206690+0000","last_active":"2024-09-17T23:04:47.728309+0000","last_peered":"2024-09-17T23:04:47.728309+0000","last_clean":"2024-09-17T23:02:28.601103+0000","last_became_active":"2024-09-17T23:02:36.206690+0000","last_became_peered":"2024-09-17T23:02:36.206690+0000","last_unstale":"2024-09-17T23:04:47.728309+0000","last_undegraded":"2024-09-17T23:02:36.206032+0000","last_fullsized":"2024-09-17T23:02:36.205941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:18.666349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":75,"state":"active+undersized","last_fresh":"2024-09-17T23:04:47.334208+0000","last_change":"2024-09-17T23:03:43.419931+0000","last_active":"2024-09-17T23:04:47.334208+0000","last_peered":"2024-09-17T23:04:47.334208+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:03:43.419931+0000","last_became_peered":"2024-09-17T23:03:43.419931+0000","last_unstale":"2024-09-17T23:04:47.334208+0000","last_undegraded":"2024-09-17T23:04:47.334208+0000","last_fullsized":"2024-09-17T23:03:43.419324+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:37.122490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"stale+active+undersized","last_fresh":"2024-09-17T23:03:08.303154+0000","last_change":"2024-09-17T23:02:36.204438+0000","last_active":"2024-09-17T23:03:08.303154+0000","last_peered":"2024-09-17T23:03:08.303154+0000","last_clean":"2024-09-17T23:02:28.597949+0000","last_became_active":"2024-09-17T23:02:36.204438+0000","last_became_peered":"2024-09-17T23:02:36.204438+0000","last_unstale":"2024-09-17T23:03:14.328698+0000","last_undegraded":"2024-09-17T23:03:08.303154+0000","last_fullsized":"2024-09-17T23:02:36.203989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:29:19.022828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"51'6","reported_seq":177,"reported_epoch":75,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:47.728377+0000","last_change":"2024-09-17T23:03:43.423198+0000","last_active":"2024-09-17T23:04:47.728377+0000","last_peered":"2024-09-17T23:04:47.728377+0000","last_clean":"2024-09-17T23:03:42.574324+0000","last_became_active":"2024-09-17T23:03:43.423198+0000","last_became_peered":"2024-09-17T23:03:43.423198+0000","last_unstale":"2024-09-17T23:04:47.728377+0000","last_undegraded":"2024-09-17T23:03:43.422693+0000","last_fullsized":"2024-09-17T23:03:43.422600+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:45:54.029051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":234,"reported_epoch":75,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:47.334205+0000","last_change":"2024-09-17T23:03:15.332337+0000","last_active":"2024-09-17T23:04:47.334205+0000","last_peered":"2024-09-17T23:04:47.334205+0000","last_clean":"2024-09-17T23:02:22.544336+0000","last_became_active":"2024-09-17T23:03:15.332337+0000","last_became_peered":"2024-09-17T23:03:15.332337+0000","last_unstale":"2024-09-17T23:04:47.334205+0000","last_undegraded":"2024-09-17T23:03:15.331270+0000","last_fullsized":"2024-09-17T23:03:15.331175+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T05:02:33.805222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":91,"num_write":17,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":8,"acting":9,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":1,"acting":1,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":995328,"data_stored":745489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":368912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574882,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":884736,"data_stored":368915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":880640,"data_stored":368896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":880640,"data_stored":368896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":215095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574882,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1474560,"data_stored":959264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:04:50.058 INFO:tasks.thrashosds.thrasher:Setting 2.3 to [2, 7] 2024-09-17T23:04:50.058 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.3', '2', '7'] 2024-09-17T23:04:50.058 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.3 2 7 2024-09-17T23:04:50.058 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:50.054+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:50.150 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:50.148+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:50.151 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.72828847900001, 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.152 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:50.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:50.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:50.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.72784156700001, 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:50.156 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:50.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.160 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.71116292599999, 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.710609256, 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.165 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.169 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.70999763200001, 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:50.173 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.70934493300001, 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.174 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:50.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:50.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.708808793, 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.178 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.179 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.180 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.181 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.69400559600001, 2024-09-17T23:04:50.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.183 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.185 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:50.186 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.693662913, 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:50.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:50.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:50.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.69309352799999, 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.194 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.690613345, 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:50.196 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:50.197 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:50.198 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.683109879, 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.199 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.200 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.201 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.202 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.682608434, 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.203 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.204 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.205 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.67997271300001, 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:50.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:50.211 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.672115042, 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:50.212 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:50.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.53400921799999, 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.216 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.219 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 148.123192432, 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.220 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 147.61935893899999, 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.224 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:50.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:50.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 147.61395781900001, 2024-09-17T23:04:50.228 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.230 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:50.232 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 72.186258971000001, 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.233 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.237 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:50.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:50.279 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:50.277+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:50.340 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:04:50.352 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:50.350+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:50.389 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:50.389 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:50.390 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:50.390 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:50.398 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:50.482 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:50.480+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:50.545 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:50.545 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:50.545 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:50.545 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:50.554 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:50.554 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:50.551+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:50.654 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:50.651+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:50.702 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 41.108463094000001, 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:50.703 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:50.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:50.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:50.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:50.707 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.707 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.707 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.707 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:50.707 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:50.707 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:50.711 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:50.755 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:50.753+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:50.825 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:50.825 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:50.825 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:50.825 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:50.834 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:50.856 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:50.854+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:50.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:50.938 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:50.938 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:50.938 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:50.938 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:50.938 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:50.947 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:50.957 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:50.955+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:51.022 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:51.022 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:51.022 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:51.022 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:51.039 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:51.039 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:51.051 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:51.052 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:51.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:51.052 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:51.052 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:51.057 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:51.057 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:51.058 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:51.054+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:51.061 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:51.074 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:51.074 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:51.090 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:51.090 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:51.091 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:51.094 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:51.094 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:51.159 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:51.157+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:51.203 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:51.204 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:51.212 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:51.259 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:51.256+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:51.315 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:51.315 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:51.324 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:51.344 INFO:teuthology.orchestra.run.smithi005.stderr:set 2.3 pg_upmap mapping to [2,7] 2024-09-17T23:04:51.364 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:51.361+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:51.461 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:51.458+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:51.468 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:51.468 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:51.477 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:51.562 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:51.559+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:51.621 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:51.622 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:51.630 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:51.671 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:51.668+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:51.763 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:51.760+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:51.773 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:51.773 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:51.782 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:51.866 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:51.863+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:51.925 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:51.925 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:51.934 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:51.978 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:51.976+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:52.053 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:52.054 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:52.063 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:52.066 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:52.063+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:52.168 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:52.165+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:52.211 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:52.211 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:52.220 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:52.269 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:52.267+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:52.327 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:52.327 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:52.336 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:52.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:04:52.369 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:52.366+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:52.471 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:52.468+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:52.486 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:52.486 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:52.498 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:52.571 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:52.569+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:52.605 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:52.605 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:52.614 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:52.671 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:52.669+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:52.721 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:52.721 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:52.730 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:52.774 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:52.771+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:52.834 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:52.834 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:52.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:52.873 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:52.872+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:52.975 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:52.973+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:52.986 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:52.986 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:52.995 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:53.076 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:53.072+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:53.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:53.099 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:53.099 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:53.108 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:53.192 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:53.189+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:53.224 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:53.225 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:53.242 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:53.243 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:53.253 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:53.253 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:53.261 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:53.261 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:53.262 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:53.277 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:53.277 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:53.277 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:53.275+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:53.294 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:53.295 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:53.298 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:53.298 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:53.352 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:04:53.378 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:53.375+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:53.406 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:53.406 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:53.407 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:53.407 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:53.407 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:53.416 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:53.500 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:53.497+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:53.561 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:53.561 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 147.32114215300001, 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:53.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:53.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:53.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.568 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 146.31964019, 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.569 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:53.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:53.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 145.313765265, 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:53.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:53.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:53.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:53.583 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.595542373000001, 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.584 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.588 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.592414696000006, 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:53.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:53.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.594 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.590565667000007, 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:53.595 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:53.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:53.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.589251587000007, 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.600 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:53.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:53.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.587679054000006, 2024-09-17T23:04:53.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:53.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.348887900999998, 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:53.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:53.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:53.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:53.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:53.616 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.347393961999998, 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:53.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:53.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:53.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:53.622 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.345465238000003, 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:53.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:53.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.343567139000001, 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:53.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:53.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:53.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.342804739000002, 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:53.636 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 70.357438557999998, 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.637 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.641 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 70.357311744, 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:53.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:53.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 60.355530819000002, 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.647 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:53.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:53.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 35.350442561000001, 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.651 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:53.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:53.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 30.349439447000002, 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:04:53.655 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:04:53.659 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.349422582999999, 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.660 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.663 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.348511353999999, 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:04:53.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:53.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:53.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:04:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:04:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:53.668 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:53.668 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:53.669 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:53.670 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:53.667+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:53.770 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:53.767+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:53.814 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:53.814 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:53.814 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:53.823 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:53.906 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:53.903+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:53.965 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:53.965 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:53.966 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:53.966 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:53.972 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:53.970+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:53.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:54.073 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:54.070+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:54.118 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.118 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 76.156987028000003, 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:54.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 76.151790548999998, 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:54.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:54.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:54.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 76.148979421000007, 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.128 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:54.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:54.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:54.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 76.105347109999997, 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.132 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 76.105005989999995, 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:54.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:54.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.140 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 76.097605896999994, 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:54.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.144 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.962391177000001, 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:54.145 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.149 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.962089927999997, 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:54.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:54.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.156 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.911681129000002, 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:54.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:54.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:54.161 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.911364456000001, 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:54.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:54.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.166 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.904324039000002, 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:54.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:54.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.904047672000004, 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:54.171 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:54.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:54.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:54.175 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 75.900764434999999, 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:54.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:54.180 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:54.182 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:54.178+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:54.182 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:54.283 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:54.279+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:54.302 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:54.302 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:54.302 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:54.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:54.384 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:54.380+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:54.420 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:54.420 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:54.420 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:54.420 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:54.421 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:54.429 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:54.484 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:54.481+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:54.538 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:54.538 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:54.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.114774643, 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:54.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.540 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.541 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:54.542 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.114327731, 2024-09-17T23:04:54.543 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:54.544 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.545 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.546 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.547 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.09764909, 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:54.548 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:54.549 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:54.550 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:54.551 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.09709541999999, 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.096483796, 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.556 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.095831097, 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.563 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:54.563 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:54.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.563 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:54.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.09529495699999, 2024-09-17T23:04:54.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.568 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:54.569 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.08049176, 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:54.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.08014907699999, 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.574 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.577 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.07957969200001, 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.579 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.580 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.07709950899999, 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.582 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.583 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:54.585 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.586 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.06959604299999, 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.589 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.06909459799999, 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:54.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.593 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.594 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.066458877, 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.595 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:54.596 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:54.597 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:54.598 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 153.05860120599999, 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.599 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:54.600 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:54.601 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:54.602 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 152.92049538200001, 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.603 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.604 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:54.605 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:54.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:54.607 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 152.50967859599999, 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:54.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:54.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:54.611 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 152.00584510300001, 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:54.612 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:54.613 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:54.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.615 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 152.000443983, 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.616 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:54.617 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:54.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.619 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.572745135000005, 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:54.620 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:54.621 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:54.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:54.623 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:54.624 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:54.625 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:54.626 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:54.623+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:54.726 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:54.723+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:54.772 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:54.773 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:54.773 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:54.773 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:54.781 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:54.827 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:54.825+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:54.888 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:54.889 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:54.889 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:54.889 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:54.889 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:54.897 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:54.928 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:54.925+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:55.004 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 45.410484222999997, 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:55.005 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:55.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:55.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:55.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:55.009 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:55.013 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:55.029 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:55.026+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:55.125 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:55.125 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:55.125 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:55.125 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:55.129 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:55.126+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:55.133 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:55.230 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:55.227+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:55.279 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:55.280 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:55.280 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:55.280 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:55.280 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:55.289 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:55.300 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:55.343 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:55.341+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:55.367 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:04:55.425 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:55.426 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:55.431 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:55.429+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:55.434 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:55.434 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:55.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:55.435 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:55.435 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:55.443 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:55.444 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:55.444 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:55.461 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:55.478 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:55.478 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:55.499 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:55.499 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:55.503 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:55.503 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:55.544 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:55.542+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:55.549 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:55.549 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:55.558 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:55.633 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:55.630+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:55.662 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:55.662 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:55.671 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:55.755 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:55.752+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:55.815 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:55.815 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:55.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:55.835 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:55.833+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:55.936 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:55.934+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:55.968 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:55.968 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:55.977 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:56.037 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:56.033+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:56.080 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:56.080 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:56.088 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:56.138 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:56.136+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:56.231 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:56.231 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:56.239 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:56.240 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:56.237+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:56.340 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:56.337+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:56.356 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:56.357 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:56.358 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:04:56.359 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:04:56.359 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:04:56.359 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T23:04:56.360 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T23:04:56.369 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:56.458 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:56.456+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:56.525 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:56.525 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:56.534 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:56.542 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:56.540+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:56.643 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:56.640+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 79, 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "4cb0491c-5273-43ce-9711-0f68bec58f2e", 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-09-17T23:02:05.418126+0000", 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-09-17T23:04:56.353421+0000", 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "last_up_change": "2024-09-17T23:03:42.411787+0000", 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "last_in_change": "2024-09-17T23:03:01.271643+0000", 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_num": 5799936, 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_set": [ 2024-09-17T23:04:56.657 INFO:teuthology.orchestra.run.smithi005.stdout: "pglog_hardlimit", 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "purged_snapdirs", 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_deletes", 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "sortbitwise" 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_version": 4, 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_snapshot": "", 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_max": 2, 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd": 8, 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "require_min_compat_client": "luminous", 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "min_compat_client": "luminous", 2024-09-17T23:04:56.658 INFO:teuthology.orchestra.run.smithi005.stdout: "require_osd_release": "squid", 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_crimson": false, 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": [ 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 1, 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": ".mgr", 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:19.615759+0000", 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool", 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:04:56.659 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 1, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 1, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 1, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 1, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 1, 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:04:56.660 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "17", 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:04:56.661 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 0, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 0, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:04:56.662 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:04:56.663 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "options": { 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_max": 32, 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_min": 1 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": {} 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:04:56.664 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 7.690000057220459, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 7.690000057220459, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.12999999523162842, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 1, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 1, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 0.99012374877929688, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 0.99000000953674316, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 0.99000000953674316 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 2, 2024-09-17T23:04:56.665 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": "rbd", 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:24.412869+0000", 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 8193, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:04:56.666 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 8, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 8, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 8, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 8, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 8, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "21", 2024-09-17T23:04:56.667 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 2, 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 21, 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:04:56.668 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:04:56.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "options": {}, 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:04:56.670 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd": {} 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "error_message": "pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable", 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 0, 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 0 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "69fa22ee-5c14-4f80-82fe-b22939183e4a", 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:56.671 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-17T23:04:56.672 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.673 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6802", 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6803", 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6806", 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6807", 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6804", 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6805", 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.676 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6801/3261733059", 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6803/3261733059", 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6807/3261733059", 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6805/3261733059", 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "a50256db-895f-4a6b-b83e-e251a3b53e10", 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:56.677 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 0.920989990234375, 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 18, 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 22, 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6816", 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:56.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6817", 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6818", 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:56.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6819", 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6822", 2024-09-17T23:04:56.680 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6823", 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.681 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6820", 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6821", 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6817/3745424715", 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6819/3745424715", 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6823/3745424715", 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6821/3745424715", 2024-09-17T23:04:56.682 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2", 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:56.683 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 36, 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 50, 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6824", 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6825", 2024-09-17T23:04:56.684 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:56.685 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.685 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.685 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:56.685 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.685 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6826", 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6827", 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6830", 2024-09-17T23:04:56.687 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:56.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.687 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6831", 2024-09-17T23:04:56.688 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:56.688 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.688 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.688 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:56.688 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.688 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6828", 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6829", 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6825/3492189306", 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6827/3492189306", 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6831/3492189306", 2024-09-17T23:04:56.689 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6829/3492189306", 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "b9664ac0-db52-42bb-aa10-9ad23cc7021a", 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:56.690 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6808", 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.691 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6809", 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6810", 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.692 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6811", 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6814", 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6815", 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6812", 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:56.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6813", 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6809/1475101831", 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6811/1475101831", 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6815/1475101831", 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6813/1475101831", 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:56.695 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "5a11b2ff-7a67-40ed-8076-90ce187a3d96", 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:56.696 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 58, 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6810", 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6811", 2024-09-17T23:04:56.697 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6812", 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.698 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6813", 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6816", 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6817", 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6814", 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6815", 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6811/1406375140", 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6813/1406375140", 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6817/1406375140", 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6815/1406375140", 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:56.701 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "2361e4e6-f10b-417b-a976-a037ac890e11", 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:04:56.702 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6818", 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6819", 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.703 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6820", 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6821", 2024-09-17T23:04:56.704 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6824", 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6825", 2024-09-17T23:04:56.705 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6822", 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.706 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6823", 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6819/2095030613", 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6821/2095030613", 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6825/2095030613", 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6823/2095030613", 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "8d3a457f-9981-4307-ac8e-4d45f1600ade", 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 39, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:04:56.708 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6802", 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6803", 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:56.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6804", 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6805", 2024-09-17T23:04:56.710 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6808", 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.711 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6809", 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6806", 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.712 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6807", 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6803/3030792595", 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6805/3030792595", 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6809/3030792595", 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6807/3030792595", 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:04:56.713 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3", 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:04:56.714 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 39, 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6826", 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6827", 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.715 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6828", 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6829", 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:56.716 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6832", 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6833", 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:56.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6830", 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6831", 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:04:56.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6827/967279289", 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6829/967279289", 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6833/967279289", 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6831/967279289", 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_xinfo": [ 2024-09-17T23:04:56.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.899917+0000", 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:56.720 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.157860+0000", 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 22 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:56.721 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.416164+0000", 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 50 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.907974+0000", 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.722 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.523463+0000", 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:56.723 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.326314+0000", 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.363775+0000", 2024-09-17T23:04:56.724 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.492325+0000", 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 39 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap": [ 2024-09-17T23:04:56.725 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.3", 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.5", 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: 0 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.7", 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: 7, 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: 4 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_items": [], 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_primaries": [], 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_temp": [ 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.7", 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: 4, 2024-09-17T23:04:56.727 INFO:teuthology.orchestra.run.smithi005.stdout: 6 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_temp": [], 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklist": {}, 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "range_blocklist": {}, 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profiles": { 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "default": { 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-failure-domain": "osd", 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "k": "2", 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "m": "1", 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin": "jerasure", 2024-09-17T23:04:56.728 INFO:teuthology.orchestra.run.smithi005.stdout: "technique": "reed_sol_van" 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps_queue": [], 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "new_removed_snaps": [], 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "new_purged_snaps": [], 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_node_flags": {}, 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "device_class_flags": {}, 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": { 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_enabled": false, 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_bucket_count": 0, 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "degraded_stretch_mode": 0, 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "recovering_stretch_mode": 0, 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_bucket": 0 2024-09-17T23:04:56.729 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:56.730 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:56.731 INFO:tasks.thrashosds.thrasher:j is {'epoch': 79, 'fsid': '4cb0491c-5273-43ce-9711-0f68bec58f2e', 'created': '2024-09-17T23:02:05.418126+0000', 'modified': '2024-09-17T23:04:56.353421+0000', 'last_up_change': '2024-09-17T23:03:42.411787+0000', 'last_in_change': '2024-09-17T23:03:01.271643+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T23:02:19.615759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 0.9901237487792969, 'average_primary_affinity': 0.9900000095367432, 'average_primary_affinity_weighted': 0.9900000095367432}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T23:02:24.412869+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'error_message': 'pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}], 'osds': [{'osd': 0, 'uuid': '69fa22ee-5c14-4f80-82fe-b22939183e4a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6800', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6801', 'nonce': 3261733059}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6802', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6803', 'nonce': 3261733059}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6806', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6807', 'nonce': 3261733059}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6804', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6805', 'nonce': 3261733059}]}, 'public_addr': '172.21.15.5:6801/3261733059', 'cluster_addr': '172.21.15.5:6803/3261733059', 'heartbeat_back_addr': '172.21.15.5:6807/3261733059', 'heartbeat_front_addr': '172.21.15.5:6805/3261733059', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a50256db-895f-4a6b-b83e-e251a3b53e10', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.920989990234375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 22, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6816', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6817', 'nonce': 3745424715}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6818', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6819', 'nonce': 3745424715}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6822', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6823', 'nonce': 3745424715}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6820', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6821', 'nonce': 3745424715}]}, 'public_addr': '172.21.15.5:6817/3745424715', 'cluster_addr': '172.21.15.5:6819/3745424715', 'heartbeat_back_addr': '172.21.15.5:6823/3745424715', 'heartbeat_front_addr': '172.21.15.5:6821/3745424715', 'state': ['exists']}, {'osd': 2, 'uuid': 'c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 36, 'down_at': 50, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6824', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6825', 'nonce': 3492189306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6826', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6827', 'nonce': 3492189306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6830', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6831', 'nonce': 3492189306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6828', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6829', 'nonce': 3492189306}]}, 'public_addr': '172.21.15.5:6825/3492189306', 'cluster_addr': '172.21.15.5:6827/3492189306', 'heartbeat_back_addr': '172.21.15.5:6831/3492189306', 'heartbeat_front_addr': '172.21.15.5:6829/3492189306', 'state': ['exists']}, {'osd': 3, 'uuid': 'b9664ac0-db52-42bb-aa10-9ad23cc7021a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6808', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6809', 'nonce': 1475101831}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6810', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6811', 'nonce': 1475101831}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6814', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6815', 'nonce': 1475101831}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6812', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6813', 'nonce': 1475101831}]}, 'public_addr': '172.21.15.5:6809/1475101831', 'cluster_addr': '172.21.15.5:6811/1475101831', 'heartbeat_back_addr': '172.21.15.5:6815/1475101831', 'heartbeat_front_addr': '172.21.15.5:6813/1475101831', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5a11b2ff-7a67-40ed-8076-90ce187a3d96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 58, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6810', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6811', 'nonce': 1406375140}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6812', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6813', 'nonce': 1406375140}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6816', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6817', 'nonce': 1406375140}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6814', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6815', 'nonce': 1406375140}]}, 'public_addr': '172.21.15.152:6811/1406375140', 'cluster_addr': '172.21.15.152:6813/1406375140', 'heartbeat_back_addr': '172.21.15.152:6817/1406375140', 'heartbeat_front_addr': '172.21.15.152:6815/1406375140', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2361e4e6-f10b-417b-a976-a037ac890e11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6818', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6819', 'nonce': 2095030613}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6820', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6821', 'nonce': 2095030613}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6824', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6825', 'nonce': 2095030613}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6822', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6823', 'nonce': 2095030613}]}, 'public_addr': '172.21.15.152:6819/2095030613', 'cluster_addr': '172.21.15.152:6821/2095030613', 'heartbeat_back_addr': '172.21.15.152:6825/2095030613', 'heartbeat_front_addr': '172.21.15.152:6823/2095030613', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8d3a457f-9981-4307-ac8e-4d45f1600ade', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 39, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6802', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6803', 'nonce': 3030792595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6804', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6805', 'nonce': 3030792595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6808', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6809', 'nonce': 3030792595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6806', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6807', 'nonce': 3030792595}]}, 'public_addr': '172.21.15.152:6803/3030792595', 'cluster_addr': '172.21.15.152:6805/3030792595', 'heartbeat_back_addr': '172.21.15.152:6809/3030792595', 'heartbeat_front_addr': '172.21.15.152:6807/3030792595', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 39, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6826', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6827', 'nonce': 967279289}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6828', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6829', 'nonce': 967279289}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 967279289}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6830', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6831', 'nonce': 967279289}]}, 'public_addr': '172.21.15.152:6827/967279289', 'cluster_addr': '172.21.15.152:6829/967279289', 'heartbeat_back_addr': '172.21.15.152:6833/967279289', 'heartbeat_front_addr': '172.21.15.152:6831/967279289', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.899917+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.157860+0000', 'dead_epoch': 22}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.416164+0000', 'dead_epoch': 50}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.907974+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.523463+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.326314+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.363775+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.492325+0000', 'dead_epoch': 39}], 'pg_upmap': [{'pgid': '2.3', 'osds': [2, 7]}, {'pgid': '2.5', 'osds': [2, 0]}, {'pgid': '2.7', 'osds': [7, 4]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '2.7', 'osds': [4, 6]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T23:04:56.731 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 2.7 2024-09-17T23:04:56.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 2.7 2024-09-17T23:04:56.732 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:56.733 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:56.733 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:56.743 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:56.741+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:56.845 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:56.841+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:56.882 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:56.882 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:56.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:56.945 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:56.943+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:56.999 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:56.999 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:57.008 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:57.051 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:57.049+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:57.115 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:57.115 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:57.123 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:57.167 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:57.164+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:57.229 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:57.229 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:57.238 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:57.279 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:57.276+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:57.348 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:57.345+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:57.365 INFO:teuthology.orchestra.run.smithi005.stderr:clear 2.7 pg_upmap mapping 2024-09-17T23:04:57.384 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:57.384 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:57.393 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:57.477 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:57.474+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:57.504 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:04:57.537 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:57.537 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:57.546 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:57.587 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:57.584+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:57.629 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:57.630 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:57.647 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:57.647 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:57.650 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:57.648+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:57.664 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:57.664 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:57.680 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:57.680 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:57.691 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:57.691 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:57.691 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:57.691 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:57.697 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:57.697 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:57.700 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:57.701 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:57.701 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:57.751 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:57.748+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:57.803 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:57.804 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:57.804 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:57.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:04:57.853 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:57.850+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:57.953 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:57.950+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:57.957 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:57.957 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:57.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 151.717820163, 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:57.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:04:57.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:57.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:57.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 150.71631819999999, 2024-09-17T23:04:57.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:57.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:57.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:04:57.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:04:57.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:04:57.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 149.71044327499999, 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:57.971 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:57.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:04:57.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:04:57.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.992220383000003, 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:57.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:04:57.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:57.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:57.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.989092705999994, 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:57.982 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:04:57.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:04:57.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:57.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.987 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.987243676999995, 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:57.988 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:57.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:57.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.985929596999995, 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:04:57.993 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:04:57.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:04:57.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:04:57.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:57.998 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.984357063999994, 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:57.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:04:58.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:58.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.745565911, 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:04:58.003 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.008 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.744071972, 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.009 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:04:58.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.014 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.742143248000005, 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:04:58.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:04:58.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:04:58.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.740245149000003, 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.020 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.024 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.739482749000004, 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.025 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 74.754116568000001, 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:04:58.029 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:04:58.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 74.753989754000003, 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.034 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:58.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:04:58.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:04:58.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 64.752208828999997, 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.039 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.040 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:04:58.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.747120570999996, 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.044 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:04:58.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:04:58.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:04:58.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 34.746117456999997, 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.048 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:04:58.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.746100593000001, 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:04:58.052 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:58.056 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 24.745189364000002, 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:58.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:04:58.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:04:58.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.060 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.061 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:58.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:04:58.062 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:58.060+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:58.162 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:58.160+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:58.205 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:58.205 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:58.205 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:58.205 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:58.214 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:04:58.263 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:58.260+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:58.316 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:58.316 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:58.316 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:58.317 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:58.317 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:58.325 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:04:58.363 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:58.361+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:58.376 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:04:58.464 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:58.461+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:58.470 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:58.470 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:58.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:58.470 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.509607768999999, 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:58.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:04:58.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:04:58.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.504411289999993, 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:58.475 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.501600162000003, 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:04:58.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:04:58.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.457967851000006, 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.457626731000005, 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:58.488 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.450226638000004, 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:04:58.492 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:04:58.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.315011917999996, 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.497 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:04:58.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.314710668999993, 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.501 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.505 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.264301869999997, 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:04:58.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.509 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.263985196999997, 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:04:58.513 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.256944779999998, 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:04:58.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:04:58.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.256668413, 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:04:58.518 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:04:58.522 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 80.253385175999995, 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:04:58.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:04:58.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:04:58.527 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.527 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.527 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.527 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:04:58.527 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:04:58.527 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:58.528 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:04:58.569 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:58.566+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:58.636 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:58.637 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:58.637 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:58.637 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:58.646 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:04:58.666 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:58.664+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:58.753 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:58.753 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:58.753 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:58.753 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:58.753 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:58.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:04:58.767 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:58.764+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:58.867 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:58.865+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:58.870 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:58.870 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:58.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:58.870 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:58.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.870 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:04:58.870 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:58.870 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.44639258199999, 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:04:58.871 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.872 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.873 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:04:58.874 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.44594566999999, 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.875 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:04:58.876 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:04:58.877 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.878 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.879 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.42926702899999, 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.880 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:04:58.881 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:04:58.882 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.883 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.428713359, 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.884 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.885 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.886 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:04:58.887 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.888 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.42810173500001, 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:58.889 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.890 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.891 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:04:58.892 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.42744903600001, 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:04:58.893 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.894 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:04:58.895 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.896 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.897 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.426912896, 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:58.898 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.899 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:04:58.900 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.901 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:04:58.902 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.41210969900001, 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.903 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.904 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.905 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.906 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.411767016, 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.907 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:04:58.908 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:04:58.909 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:04:58.910 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.41119763099999, 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:04:58.911 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.912 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:04:58.913 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:04:58.914 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.915 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.408717448, 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.919 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.401213982, 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.920 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.921 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.922 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.923 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.400712537, 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:04:58.924 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.925 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:04:58.926 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:04:58.927 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.928 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.39807681600001, 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.929 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:04:58.930 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:04:58.931 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:04:58.932 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.390219145, 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.933 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.934 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.935 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:04:58.936 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 157.252113321, 2024-09-17T23:04:58.937 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.938 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:04:58.939 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.940 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.941 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 156.841296535, 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:58.942 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:04:58.943 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:04:58.944 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:04:58.945 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 156.337463042, 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.946 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:04:58.947 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:04:58.948 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.949 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:58.950 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 156.33206192200001, 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.951 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.952 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.953 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.954 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 80.904363074000003, 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:04:58.955 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.956 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.957 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.958 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:04:58.959 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.960 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.960 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.960 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:58.960 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:58.960 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:58.961 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:04:58.968 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:58.966+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:59.068 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:59.069 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:04:59.069 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:59.069 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:04:59.066+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:04:59.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:04:59.170 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:59.167+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:59.223 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:59.224 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:04:59.224 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:04:59.224 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:04:59.224 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:59.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:04:59.271 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:59.269+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:59.339 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:04:59.339 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 49.745347354000003, 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:04:59.340 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:04:59.341 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:04:59.342 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:04:59.343 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:04:59.344 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:04:59.344 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:04:59.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:59.344 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:59.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:59.344 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:04:59.344 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:04:59.344 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:04:59.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:04:59.374 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:04:59.392 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:59.389+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:59.465 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:59.465 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:59.466 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:04:59.466 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:59.473 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:59.471+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:04:59.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:04:59.573 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:04:59.570+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:04:59.621 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:59.621 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:04:59.621 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:04:59.621 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:04:59.621 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:59.630 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:04:59.703 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:04:59.714 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:04:59.711+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:04:59.773 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:04:59.773 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:04:59.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:04:59.774 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:04:59.774 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:04:59.775 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:59.772+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:59.783 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:04:59.828 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:04:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:04:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:04:59.828 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:04:59.845 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:04:59.845 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:04:59.862 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:04:59.862 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:04:59.875 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:04:59.872+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:04:59.880 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:04:59.880 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:04:59.897 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:04:59.897 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:04:59.897 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:04:59.900 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:04:59.901 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:04:59.929 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:04:59.929 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:04:59.938 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:04:59.977 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:04:59.975+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:00.078 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:00.075+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:00.183 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:00.183 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:00.184 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:00.184 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:00.180+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:00.284 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:00.280+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:00.327 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:00.327 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:00.335 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:00.419 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:00.416+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:00.478 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:00.479 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:00.486 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:00.484+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:00.487 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:00.587 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:00.584+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:00.631 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:00.631 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:00.640 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:00.725 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:00.722+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:00.783 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:00.784 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:00.789 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:00.787+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:00.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:00.890 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:00.888+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:00.912 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:00.921 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:01.005 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:01.003+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:01.069 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:01.069 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:01.078 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:01.091 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:01.089+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:01.192 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:01.190+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:01.224 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:01.225 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:01.233 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:01.293 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:01.291+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:01.340 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:01.340 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:01.349 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:01.388 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:05:01.394 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:01.390+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:01.494 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:01.492+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:01.499 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:01.499 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:01.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:01.595 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:01.592+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:01.618 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:01.618 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:01.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:01.695 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:01.692+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:01.739 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:01.739 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:01.747 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:01.831 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:01.828+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:01.891 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:01.891 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:01.896 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:01.893+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:01.900 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:01.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:01.997 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:01.994+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:02.027 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:02.027 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:02.045 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:02.045 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:02.045 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:02.045 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:02.053 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:02.061 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:02.061 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:02.078 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:02.078 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:02.095 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:02.095 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:02.095 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:02.098 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:02.096+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:02.099 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:02.099 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:02.196 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:02.196 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:02.196 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:02.199 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:02.196+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:02.205 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:02.300 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:02.297+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:02.349 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:02.350 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:02.350 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:02.350 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:02.350 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:02.359 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:02.375 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:05:02.379 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7, 4] out_osds: [] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:05:02.380 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:05:02.380 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [0, 1, 2, 3, 5, 6, 7, 4] 2024-09-17T23:05:02.380 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-09-17T23:05:02.401 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:02.398+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:02.501 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:02.499+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 156.26524540400001, 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.505 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:02.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 155.263743441, 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.512 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:05:02.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:02.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:02.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:05:02.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 154.257868516, 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:05:02.518 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:05:02.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:05:02.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.524 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.539645624000002, 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.536517946999993, 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:02.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:05:02.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:05:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:05:02.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.534668917999994, 2024-09-17T23:05:02.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:05:02.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.533354837999994, 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.539 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:02.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.531782304999993, 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.544 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:05:02.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:05:02.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.292991151999999, 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.549 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.291497213, 2024-09-17T23:05:02.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:05:02.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.289568489000004, 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.560 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:05:02.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:05:02.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.287670390000002, 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:05:02.565 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.286907990000003, 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.574 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.301541809, 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:02.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:02.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 79.301414995000002, 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:02.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:02.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 69.299634069999996, 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:05:02.585 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 44.294545812000003, 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:05:02.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:05:02.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:05:02.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 39.293542698000003, 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.594 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:05:02.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:02.598 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 34.293525834, 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:05:02.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.601 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 29.292614605000001, 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:05:02.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:02.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.605 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:02.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:02.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:05:02.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:05:02.607 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.607 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.607 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.607 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:02.607 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:02.608 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:02.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:02.609 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:02.606+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:02.678 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-17T23:05:02.676+0000 7fcae0ef7640 -1 mon.a@0(leader).osd e83 definitely_dead 0 2024-09-17T23:05:02.710 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:02.706+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:02.752 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:02.752 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:02.752 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:02.752 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:02.761 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:02.811 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:02.809+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:02.905 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:02.905 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:02.905 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:02.911 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:02.908+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:02.914 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:03.012 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:03.010+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:03.058 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:03.058 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:03.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:03.058 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 85.097385746, 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.059 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:05:03.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.061 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.062 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 85.092189266999995, 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.063 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:05:03.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.065 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:05:03.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 85.089378139000004, 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.068 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.072 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 85.045745827999994, 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 85.045404708000007, 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.077 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:05:03.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 85.038004615000006, 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:05:03.081 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:05:03.085 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.902789894999998, 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:03.086 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.902488645999995, 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.090 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:05:03.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:05:03.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.094 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.852079846999999, 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:05:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:05:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:05:03.098 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.851763173999998, 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:05:03.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:03.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.844722757, 2024-09-17T23:05:03.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.107 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.844446390000002, 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:05:03.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.109 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:03.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 84.841163152999997, 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:03.112 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:05:03.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.117 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:03.117 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:03.117 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:03.118 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:03.115+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:03.118 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:03.218 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:03.216+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:03.233 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:03.233 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:03.233 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:03.233 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:03.242 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:03.326 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:03.324+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:03.379 INFO:teuthology.orchestra.run.smithi005.stderr:marked out osd.7. 2024-09-17T23:05:03.393 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:03.393 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:03.393 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:03.393 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:03.393 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:03.402 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:03.419 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:03.417+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:03.520 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:03.518+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.12719510700001, 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.551 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.552 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.553 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.554 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:03.555 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.126748195, 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.556 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:05:03.557 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.558 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.559 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.11006955400001, 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.560 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:05:03.561 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.562 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:05:03.563 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.10951588399999, 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.564 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:03.565 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.566 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.567 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.568 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.10890426, 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:03.569 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.570 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:05:03.571 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:05:03.572 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.108251561, 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.573 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:05:03.574 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.575 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.576 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.10771542099999, 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.577 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:05:03.578 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:05:03.579 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:05:03.580 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.092912224, 2024-09-17T23:05:03.581 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.582 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.583 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.584 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.585 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.09256954099999, 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.586 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:05:03.587 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:05:03.588 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.589 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.09200015600001, 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.590 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:05:03.591 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:05:03.592 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:05:03.593 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.08951997299999, 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.594 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.595 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.596 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:05:03.597 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.08201650699999, 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:05:03.598 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.599 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:05:03.600 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.601 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.602 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.08151506199999, 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:05:03.603 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.604 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:05:03.605 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:05:03.606 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.607 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.078879341, 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.608 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.609 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.610 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.611 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:05:03.612 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 162.07102166999999, 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.613 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.614 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:05:03.615 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.616 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 161.93291584599999, 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:03.617 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:05:03.618 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.619 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.620 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 161.52209905999999, 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:05:03.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:05:03.624 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 161.01826556699999, 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:03.625 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:05:03.626 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:05:03.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:05:03.628 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 161.012864447, 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.629 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:05:03.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:05:03.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.632 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:03.633 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 85.585165599000007, 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:03.634 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:05:03.635 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:05:03.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:05:03.637 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:03.638 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:03.639 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:03.640 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:03.638+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:03.740 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:03.737+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:03.787 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:03.787 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:03.787 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:03.787 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:03.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:03.841 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:03.838+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:03.902 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:03.903 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:03.911 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:03.941 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:03.938+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:04.018 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:04.018 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:04.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:04.018 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:04.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.018 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 54.424180233000001, 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:04.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:04.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:04.022 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:04.027 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:04.071 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:04.069+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:04.100 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:05:04.142 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:04.139+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:04.143 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:04.143 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:04.143 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:04.143 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:04.152 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:04.224 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:04.241 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:04.243 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:04.240+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:04.258 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:04.275 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:04.292 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:04.296 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:04.297 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:04.298 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:04.298 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:04.306 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:04.350 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:04.348+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:04.391 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:05:04.414 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:04.414 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:04.423 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:04.464 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:04.462+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:04.545 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:04.542+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:04.567 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:04.576 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:04.661 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:04.659+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:04.719 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:04.719 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:04.728 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:04.769 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:04.767+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:04.847 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:04.844+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:04.872 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:04.872 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:04.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:04.965 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:04.963+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:05.026 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:05.026 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:05.035 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:05.076 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:05.074+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:05.155 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:05.152+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:05.179 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:05.179 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:05.188 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:05.256 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:05.253+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:05.336 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:05.337 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:05.346 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:05.383 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:05:05.383 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:05.381+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:05.456 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:05.453+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:05.470 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:05.470 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:05.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:05.557 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:05.554+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:05.586 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:05.587 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:05.596 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:05.658 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:05.656+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:05.743 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:05.743 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:05.752 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:05.758 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:05.756+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:05.859 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:05.857+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:05.859 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:05.860 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:05.868 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:05.960 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:05.958+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:06.015 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:06.015 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:06.024 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:06.062 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:06.059+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:06.163 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:06.161+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:06.171 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:06.171 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:06.180 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:06.264 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:06.263+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:06.293 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:06.293 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:06.297 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:06.302 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:06.365 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:06.363+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:06.408 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:06.408 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:06.417 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:06.423 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:06.424 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:06.442 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:06.442 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:06.459 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:06.459 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:06.478 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:06.478 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:06.495 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:06.495 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:06.495 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:06.499 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:06.499 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:06.502 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:06.499+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:06.561 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:06.561 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:06.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:06.561 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:05:06.561 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:06.567 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:06.564+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:06.570 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:06.667 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:06.665+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:06.714 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:06.714 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:06.714 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:06.714 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:06.723 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:06.807 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:06.805+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:06.867 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:06.867 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:06.867 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:06.867 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:06.867 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:06.868 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:06.866+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:06.876 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:06.969 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:06.966+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 160.781124111, 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.021 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:07.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:07.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:07.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 159.77962214799999, 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.028 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:07.029 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:05:07.030 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:07.031 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:07.032 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.033 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:07.034 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 158.77374722299999, 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.035 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:05:07.036 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:05:07.037 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:05:07.038 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.039 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.040 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.055524331000001, 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:05:07.041 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:05:07.042 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:05:07.043 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:05:07.044 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.052396654000006, 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.045 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.046 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.047 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.048 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:05:07.049 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.050 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.050547624999993, 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.051 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.052 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.053 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.054 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:07.055 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.049233545000007, 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:07.056 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:05:07.057 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:05:07.058 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:05:07.059 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.047661012000006, 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.060 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.061 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.062 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.063 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.064 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 88.808869858999998, 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.065 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.066 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.067 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.068 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.069 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.070 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 88.807375919999998, 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:07.071 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:05:07.072 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:05:07.073 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:05:07.074 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:05:07.075 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 88.805447196000003, 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.076 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.077 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.078 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.079 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 88.803549097000001, 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.081 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:07.085 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 88.802786697000002, 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:05:07.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:05:07.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.089 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 83.817420515999999, 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:07.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:07.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:07.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:07.094 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 83.817293702000001, 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.096 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 73.815512776999995, 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.099 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:07.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:07.103 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 48.810424519000001, 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:38 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-17T23:05:07.107 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 43.809421405000002, 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036564099999999999, 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 38 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:05:07.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208149+0000", 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208150+0000", 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1699999999999998e-07 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208174+0000", 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3849000000000002e-05 2024-09-17T23:05:07.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208181+0000", 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9829999999999999e-06 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208189+0000", 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3850000000000002e-06 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208307+0000", 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011836999999999999 2024-09-17T23:05:07.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208388+0000", 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0848999999999998e-05 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:23.208515+0000", 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012668799999999999 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:05:07.111 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.809404540999999, 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.112 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 33.808493312000003, 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.117 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.119 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.120 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.120 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.120 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.120 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:07.121 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:07.121 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:07.119+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:07.222 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:07.219+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:07.266 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:07.266 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:07.266 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:07.266 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:07.275 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:07.359 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:07.357+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:07.405 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:05:07.420 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:07.420 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:07.420 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:07.420 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:07.420 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:07.423 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:07.421+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:07.429 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:07.524 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:07.522+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:07.575 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:07.575 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:07.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:07.575 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:07.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.614288122999994, 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.579 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.609091644000003, 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.584 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.606280515999998, 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:07.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:05:07.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.562648205000002, 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:05:07.588 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.591 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.592 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.562307085, 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.593 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:05:07.594 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:05:07.595 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.596 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.554906991999999, 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.597 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.598 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.599 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.600 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.419692272000006, 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.601 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:05:07.602 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:05:07.603 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:05:07.604 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.419391023000003, 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:07.605 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:05:07.606 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:05:07.607 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:05:07.608 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.368982224000007, 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.610 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.611 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.612 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.368665551000007, 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.613 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.614 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.615 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.617 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.361625133999993, 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:05:07.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.361348766999996, 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.622 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:05:07.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 89.358065530000005, 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:05:07.626 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:07.630 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:07.632 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:07.629+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:07.632 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:07.732 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:07.730+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:07.741 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:07.741 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:07.741 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:07.741 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:07.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:07.833 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:07.831+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:07.856 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:07.856 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:07.856 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:07.856 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:07.856 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:07.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:07.934 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:07.931+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:07.973 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:07.973 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:07.973 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:07.973 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:07.973 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.973 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:05:07.973 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:07.973 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.549441634, 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.974 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:05:07.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:05:07.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:05:07.977 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.548994722, 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:07.978 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.979 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:05:07.980 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:07.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.532316081, 2024-09-17T23:05:07.982 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:05:07.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:05:07.985 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.986 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.53176241099999, 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:05:07.989 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:05:07.990 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.531150787, 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.991 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.992 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.993 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.530498088, 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:07.995 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:05:07.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:07.997 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:07.998 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.52996194799999, 2024-09-17T23:05:07.999 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:05:08.001 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:05:08.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.515158751, 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:05:08.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:05:08.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:05:08.007 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.51481606799999, 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.009 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.010 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.51424668300001, 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:08.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:05:08.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.51176649999999, 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.016 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:05:08.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:05:08.019 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.50426303399999, 2024-09-17T23:05:08.020 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:05:08.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:05:08.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.50376158899999, 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.027 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:05:08.029 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.501125868, 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:05:08.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:05:08.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.49326819699999, 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.034 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.037 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 166.35516237300001, 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.039 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:05:08.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.041 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 165.94434558699999, 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:05:08.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 165.44051209400001, 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.046 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:05:08.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:05:08.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:05:08.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 165.435110974, 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.050 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.053 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 90.007412126000006, 2024-09-17T23:05:08.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:05:08.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:05:08.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.059 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:08.060 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:08.061 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:08.057+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:08.161 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:08.158+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:08.208 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:08.208 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:08.208 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:08.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:08.261 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:08.259+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:08.361 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:08.358+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:08.363 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:08.363 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:08.364 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:08.372 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:08.395 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 4] out_osds: [7] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:05:08.395 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:05:08.395 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-17T23:05:08.396 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-17T23:05:08.447 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:05:08.463 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:08.460+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:08.500 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 58.933540548000003, 2024-09-17T23:05:08.528 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.529 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:05:08.530 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:08.531 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.532 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:08.537 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:08.578 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:08.575+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:08.633 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:08.634 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:08.634 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:08.634 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:08.652 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:08.652 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:08.654 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:08.654 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:08.654 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:08.654 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:08.663 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:08.664 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:08.662+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:08.669 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:08.670 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:08.686 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:08.686 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:08.703 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:08.703 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:08.707 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:08.707 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 89, 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "fsid": "4cb0491c-5273-43ce-9711-0f68bec58f2e", 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "created": "2024-09-17T23:02:05.418126+0000", 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "modified": "2024-09-17T23:05:08.440594+0000", 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "last_up_change": "2024-09-17T23:03:42.411787+0000", 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "last_in_change": "2024-09-17T23:05:03.373834+0000", 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-17T23:05:08.717 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_num": 5799936, 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_set": [ 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "pglog_hardlimit", 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "purged_snapdirs", 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "recovery_deletes", 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "sortbitwise" 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_version": 4, 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "full_ratio": 0.94999998807907104, 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_snapshot": "", 2024-09-17T23:05:08.718 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_max": 2, 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "max_osd": 8, 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "require_min_compat_client": "luminous", 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "min_compat_client": "luminous", 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "require_osd_release": "squid", 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "allow_crimson": false, 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "pools": [ 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 1, 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": ".mgr", 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:19.615759+0000", 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 1, 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool", 2024-09-17T23:05:08.719 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 1, 2024-09-17T23:05:08.720 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 1, 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 1, 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 1, 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 1, 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:05:08.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "17", 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 0, 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 0, 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:05:08.722 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:05:08.723 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:05:08.724 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "options": { 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_max": 32, 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_min": 1 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": {} 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:05:08.725 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 8, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 8, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.25, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 2, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 2, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 0.99012374877929688, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 0.99000000953674316, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 0.99000000953674316 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "pool": 2, 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_name": "rbd", 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "create_time": "2024-09-17T23:02:24.412869+0000", 2024-09-17T23:05:08.726 INFO:teuthology.orchestra.run.smithi005.stdout: "flags": 8193, 2024-09-17T23:05:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-17T23:05:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "type": 1, 2024-09-17T23:05:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 2, 2024-09-17T23:05:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "min_size": 1, 2024-09-17T23:05:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_rule": 0, 2024-09-17T23:05:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_count": 0, 2024-09-17T23:05:08.727 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_target": 0, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_barrier": 0, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "is_stretch_pool": false, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "object_hash": 2, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_autoscale_mode": "off", 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num": 8, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num": 8, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_placement_num_target": 8, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_target": 8, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_num_pending": 8, 2024-09-17T23:05:08.728 INFO:teuthology.orchestra.run.smithi005.stdout: "last_pg_merge_meta": { 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "source_pgid": "0.0", 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "ready_epoch": 0, 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_started": 0, 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "last_epoch_clean": 0, 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "source_version": "0'0", 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "target_version": "0'0" 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "last_change": "21", 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend": "0", 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "last_force_op_resend_preluminous": "0", 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "auid": 0, 2024-09-17T23:05:08.729 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_mode": "selfmanaged", 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_seq": 2, 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "snap_epoch": 21, 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "pool_snaps": [], 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps": "[]", 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_bytes": 0, 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "quota_max_objects": 0, 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tiers": [], 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_of": -1, 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "read_tier": -1, 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "write_tier": -1, 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_mode": "none", 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_bytes": 0, 2024-09-17T23:05:08.730 INFO:teuthology.orchestra.run.smithi005.stdout: "target_max_objects": 0, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_flush_age": 0, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "cache_min_evict_age": 0, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profile": "", 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_params": { 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "none" 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_period": 0, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_count": 0, 2024-09-17T23:05:08.731 INFO:teuthology.orchestra.run.smithi005.stdout: "use_gmt_hitset": true, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "min_read_recency_for_promote": 0, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "min_write_recency_for_promote": 0, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_grade_decay_rate": 0, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "hit_set_search_last_n": 0, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "grade_table": [], 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "stripe_width": 0, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "expected_num_objects": 0, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "fast_read": false, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "options": {}, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "application_metadata": { 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "rbd": {} 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.732 INFO:teuthology.orchestra.run.smithi005.stdout: "read_balance": { 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "score_type": "Fair distribution", 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "score_acting": 3, 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "score_stable": 3, 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "optimal_score": 0.5, 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_acting": 1.5, 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "raw_score_stable": 1.5, 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity_weighted": 0.99012374877929688, 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity": 0.99000000953674316, 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "average_primary_affinity_weighted": 0.99000000953674316 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:08.733 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "69fa22ee-5c14-4f80-82fe-b22939183e4a", 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 87, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:05:08.734 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6800", 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6801", 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.735 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6802", 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6803", 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.736 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6806", 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6807", 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:05:08.737 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6804", 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.738 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6805", 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3261733059 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6801/3261733059", 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6803/3261733059", 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6807/3261733059", 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6805/3261733059", 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:05:08.739 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "a50256db-895f-4a6b-b83e-e251a3b53e10", 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 0.920989990234375, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 18, 2024-09-17T23:05:08.740 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 22, 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6816", 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6817", 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:05:08.741 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6818", 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6819", 2024-09-17T23:05:08.742 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6822", 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6823", 2024-09-17T23:05:08.743 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6820", 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6821", 2024-09-17T23:05:08.744 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3745424715 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6817/3745424715", 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6819/3745424715", 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6823/3745424715", 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6821/3745424715", 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.745 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2", 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 36, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 50, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.746 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6824", 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6825", 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.747 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6826", 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6827", 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:05:08.748 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6830", 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6831", 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.749 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6828", 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6829", 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3492189306 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6825/3492189306", 2024-09-17T23:05:08.750 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6827/3492189306", 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6831/3492189306", 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6829/3492189306", 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "b9664ac0-db52-42bb-aa10-9ad23cc7021a", 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:05:08.751 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 50, 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6808", 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.752 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6809", 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6810", 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6811", 2024-09-17T23:05:08.753 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6814", 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6815", 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:05:08.754 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6812", 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.5:6813", 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1475101831 2024-09-17T23:05:08.755 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.5:6809/1475101831", 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.5:6811/1475101831", 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.5:6815/1475101831", 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.5:6813/1475101831", 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.756 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "5a11b2ff-7a67-40ed-8076-90ce187a3d96", 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 80, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:05:08.757 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6810", 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6811", 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.758 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6812", 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6813", 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.759 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6816", 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6817", 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:05:08.760 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6814", 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6815", 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 1406375140 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.761 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6811/1406375140", 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6813/1406375140", 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6817/1406375140", 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6815/1406375140", 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "2361e4e6-f10b-417b-a976-a037ac890e11", 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:05:08.762 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 84, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6818", 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.763 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6819", 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6820", 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.764 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6821", 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6824", 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:05:08.765 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6825", 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6822", 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.766 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6823", 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 2095030613 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6819/2095030613", 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6821/2095030613", 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6825/2095030613", 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6823/2095030613", 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:05:08.767 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "8d3a457f-9981-4307-ac8e-4d45f1600ade", 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 1, 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 1, 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 1, 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:05:08.768 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 81, 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 0, 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6802", 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:05:08.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6803", 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6804", 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:05:08.770 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6805", 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6808", 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.771 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6809", 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6806", 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.772 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6807", 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 3030792595 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6803/3030792595", 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6805/3030792595", 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6809/3030792595", 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6807/3030792595", 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "exists", 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: "up" 2024-09-17T23:05:08.773 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "uuid": "0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3", 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "up": 0, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "in": 0, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "weight": 0, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_affinity": 1, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_begin": 0, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "last_clean_end": 0, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "up_from": 13, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "up_thru": 22, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "down_at": 39, 2024-09-17T23:05:08.774 INFO:teuthology.orchestra.run.smithi005.stdout: "lost_at": 0, 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addrs": { 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6826", 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6827", 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.775 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addrs": { 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6828", 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6829", 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:05:08.776 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addrs": { 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6832", 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.777 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6833", 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addrs": { 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addrvec": [ 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v2", 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6830", 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "type": "v1", 2024-09-17T23:05:08.778 INFO:teuthology.orchestra.run.smithi005.stdout: "addr": "172.21.15.152:6831", 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "nonce": 967279289 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "public_addr": "172.21.15.152:6827/967279289", 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "cluster_addr": "172.21.15.152:6829/967279289", 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_back_addr": "172.21.15.152:6833/967279289", 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "heartbeat_front_addr": "172.21.15.152:6831/967279289", 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "state": [ 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "exists" 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:08.779 INFO:teuthology.orchestra.run.smithi005.stdout: "osd_xinfo": [ 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 0, 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.899917+0000", 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 1, 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:05:08.780 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.157860+0000", 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 22 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 2, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:05:08.781 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.416164+0000", 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 50 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 3, 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:14.907974+0000", 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 4, 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.523463+0000", 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 5, 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:05:08.783 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.326314+0000", 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 6, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 0, 2024-09-17T23:05:08.784 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.363775+0000", 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 0 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": 7, 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "down_stamp": "0.000000", 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_probability": 0, 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "laggy_interval": 0, 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "features": 4540701547738038271, 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "old_weight": 65536, 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "last_purged_snaps_scrub": "2024-09-17T23:02:15.492325+0000", 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "dead_epoch": 39 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:08.785 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap": [ 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.3", 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: 7 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.5", 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: 2, 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: 0 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.786 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_items": [], 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_upmap_primaries": [], 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "pg_temp": [ 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "pgid": "2.7", 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "osds": [ 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: 6, 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: 4 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "primary_temp": [], 2024-09-17T23:05:08.787 INFO:teuthology.orchestra.run.smithi005.stdout: "blocklist": {}, 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "range_blocklist": {}, 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "erasure_code_profiles": { 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "default": { 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "crush-failure-domain": "osd", 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "k": "2", 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "m": "1", 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "plugin": "jerasure", 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "technique": "reed_sol_van" 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "removed_snaps_queue": [], 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "new_removed_snaps": [], 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "new_purged_snaps": [], 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "crush_node_flags": {}, 2024-09-17T23:05:08.788 INFO:teuthology.orchestra.run.smithi005.stdout: "device_class_flags": {}, 2024-09-17T23:05:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode": { 2024-09-17T23:05:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_enabled": false, 2024-09-17T23:05:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_bucket_count": 0, 2024-09-17T23:05:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "degraded_stretch_mode": 0, 2024-09-17T23:05:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "recovering_stretch_mode": 0, 2024-09-17T23:05:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: "stretch_mode_bucket": 0 2024-09-17T23:05:08.789 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:08.789 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:08.791 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:08.791 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:08.791 INFO:tasks.thrashosds.thrasher:j is {'epoch': 89, 'fsid': '4cb0491c-5273-43ce-9711-0f68bec58f2e', 'created': '2024-09-17T23:02:05.418126+0000', 'modified': '2024-09-17T23:05:08.440594+0000', 'last_up_change': '2024-09-17T23:03:42.411787+0000', 'last_in_change': '2024-09-17T23:05:03.373834+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T23:02:19.615759+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.9901237487792969, 'average_primary_affinity': 0.9900000095367432, 'average_primary_affinity_weighted': 0.9900000095367432}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-17T23:02:24.412869+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.5, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9901237487792969, 'average_primary_affinity': 0.9900000095367432, 'average_primary_affinity_weighted': 0.9900000095367432}}], 'osds': [{'osd': 0, 'uuid': '69fa22ee-5c14-4f80-82fe-b22939183e4a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 87, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6800', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6801', 'nonce': 3261733059}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6802', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6803', 'nonce': 3261733059}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6806', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6807', 'nonce': 3261733059}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6804', 'nonce': 3261733059}, {'type': 'v1', 'addr': '172.21.15.5:6805', 'nonce': 3261733059}]}, 'public_addr': '172.21.15.5:6801/3261733059', 'cluster_addr': '172.21.15.5:6803/3261733059', 'heartbeat_back_addr': '172.21.15.5:6807/3261733059', 'heartbeat_front_addr': '172.21.15.5:6805/3261733059', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'a50256db-895f-4a6b-b83e-e251a3b53e10', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 0.920989990234375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 22, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6816', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6817', 'nonce': 3745424715}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6818', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6819', 'nonce': 3745424715}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6822', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6823', 'nonce': 3745424715}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6820', 'nonce': 3745424715}, {'type': 'v1', 'addr': '172.21.15.5:6821', 'nonce': 3745424715}]}, 'public_addr': '172.21.15.5:6817/3745424715', 'cluster_addr': '172.21.15.5:6819/3745424715', 'heartbeat_back_addr': '172.21.15.5:6823/3745424715', 'heartbeat_front_addr': '172.21.15.5:6821/3745424715', 'state': ['exists']}, {'osd': 2, 'uuid': 'c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2', 'up': 0, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 36, 'down_at': 50, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6824', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6825', 'nonce': 3492189306}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6826', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6827', 'nonce': 3492189306}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6830', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6831', 'nonce': 3492189306}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6828', 'nonce': 3492189306}, {'type': 'v1', 'addr': '172.21.15.5:6829', 'nonce': 3492189306}]}, 'public_addr': '172.21.15.5:6825/3492189306', 'cluster_addr': '172.21.15.5:6827/3492189306', 'heartbeat_back_addr': '172.21.15.5:6831/3492189306', 'heartbeat_front_addr': '172.21.15.5:6829/3492189306', 'state': ['exists']}, {'osd': 3, 'uuid': 'b9664ac0-db52-42bb-aa10-9ad23cc7021a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 50, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6808', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6809', 'nonce': 1475101831}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6810', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6811', 'nonce': 1475101831}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6814', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6815', 'nonce': 1475101831}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.5:6812', 'nonce': 1475101831}, {'type': 'v1', 'addr': '172.21.15.5:6813', 'nonce': 1475101831}]}, 'public_addr': '172.21.15.5:6809/1475101831', 'cluster_addr': '172.21.15.5:6811/1475101831', 'heartbeat_back_addr': '172.21.15.5:6815/1475101831', 'heartbeat_front_addr': '172.21.15.5:6813/1475101831', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '5a11b2ff-7a67-40ed-8076-90ce187a3d96', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6810', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6811', 'nonce': 1406375140}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6812', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6813', 'nonce': 1406375140}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6816', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6817', 'nonce': 1406375140}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6814', 'nonce': 1406375140}, {'type': 'v1', 'addr': '172.21.15.152:6815', 'nonce': 1406375140}]}, 'public_addr': '172.21.15.152:6811/1406375140', 'cluster_addr': '172.21.15.152:6813/1406375140', 'heartbeat_back_addr': '172.21.15.152:6817/1406375140', 'heartbeat_front_addr': '172.21.15.152:6815/1406375140', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '2361e4e6-f10b-417b-a976-a037ac890e11', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 84, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6818', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6819', 'nonce': 2095030613}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6820', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6821', 'nonce': 2095030613}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6824', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6825', 'nonce': 2095030613}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6822', 'nonce': 2095030613}, {'type': 'v1', 'addr': '172.21.15.152:6823', 'nonce': 2095030613}]}, 'public_addr': '172.21.15.152:6819/2095030613', 'cluster_addr': '172.21.15.152:6821/2095030613', 'heartbeat_back_addr': '172.21.15.152:6825/2095030613', 'heartbeat_front_addr': '172.21.15.152:6823/2095030613', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '8d3a457f-9981-4307-ac8e-4d45f1600ade', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 81, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6802', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6803', 'nonce': 3030792595}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6804', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6805', 'nonce': 3030792595}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6808', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6809', 'nonce': 3030792595}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6806', 'nonce': 3030792595}, {'type': 'v1', 'addr': '172.21.15.152:6807', 'nonce': 3030792595}]}, 'public_addr': '172.21.15.152:6803/3030792595', 'cluster_addr': '172.21.15.152:6805/3030792595', 'heartbeat_back_addr': '172.21.15.152:6809/3030792595', 'heartbeat_front_addr': '172.21.15.152:6807/3030792595', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 22, 'down_at': 39, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6826', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6827', 'nonce': 967279289}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6828', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6829', 'nonce': 967279289}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6832', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6833', 'nonce': 967279289}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6830', 'nonce': 967279289}, {'type': 'v1', 'addr': '172.21.15.152:6831', 'nonce': 967279289}]}, 'public_addr': '172.21.15.152:6827/967279289', 'cluster_addr': '172.21.15.152:6829/967279289', 'heartbeat_back_addr': '172.21.15.152:6833/967279289', 'heartbeat_front_addr': '172.21.15.152:6831/967279289', 'state': ['exists']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.899917+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.157860+0000', 'dead_epoch': 22}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.416164+0000', 'dead_epoch': 50}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:14.907974+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.523463+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.326314+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.363775+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-17T23:02:15.492325+0000', 'dead_epoch': 39}], 'pg_upmap': [{'pgid': '2.3', 'osds': [2, 7]}, {'pgid': '2.5', 'osds': [2, 0]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [{'pgid': '2.7', 'osds': [6, 4]}], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-17T23:05:08.792 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:05:08.792 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:08.792 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:08.788+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:08.891 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:08.889+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:08.935 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:08.935 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:08.944 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:09.028 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:09.026+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:09.087 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:09.087 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:09.092 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:09.090+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:09.096 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:09.123 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:05:09.123 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:05:09.135 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-17T23:05:08.446185+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590403,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":227,"num_read_kb":191,"num_write":176,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":10,"acting":11,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":211964,"kb_used_data":6120,"kb_used_omap":10,"kb_used_meta":205685,"kb_avail":660390916,"statfs":{"total":676457349120,"available":676240297984,"internally_reserved":0,"allocated":6266880,"data_stored":2951259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11160,"internal_metadata":210621544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.068996"},"pg_stats":[{"pgid":"2.7","version":"47'1","reported_seq":106,"reported_epoch":84,"state":"active+clean+remapped","last_fresh":"2024-09-17T23:05:03.378929+0000","last_change":"2024-09-17T23:04:59.378601+0000","last_active":"2024-09-17T23:05:03.378929+0000","last_peered":"2024-09-17T23:05:03.378929+0000","last_clean":"2024-09-17T23:05:03.378929+0000","last_became_active":"2024-09-17T23:04:59.378078+0000","last_became_peered":"2024-09-17T23:04:59.378078+0000","last_unstale":"2024-09-17T23:05:03.378929+0000","last_undegraded":"2024-09-17T23:05:03.378929+0000","last_fullsized":"2024-09-17T23:05:03.378929+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:25:38.050415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00042089200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6,4],"avail_no_missing":["6","4"],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"47'1","reported_seq":138,"reported_epoch":84,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:05:03.378925+0000","last_change":"2024-09-17T23:03:38.010425+0000","last_active":"2024-09-17T23:05:03.378925+0000","last_peered":"2024-09-17T23:05:03.378925+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.206501+0000","last_became_peered":"2024-09-17T23:02:36.206501+0000","last_unstale":"2024-09-17T23:05:03.378925+0000","last_undegraded":"2024-09-17T23:03:37.965028+0000","last_fullsized":"2024-09-17T23:02:36.205957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T23:14:38.209826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6],"acting":[6],"avail_no_missing":["6"],"object_location_counts":[{"shards":"6","objects":1}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":76,"reported_epoch":84,"state":"active+undersized","last_fresh":"2024-09-17T23:05:03.377536+0000","last_change":"2024-09-17T23:03:43.419919+0000","last_active":"2024-09-17T23:05:03.377536+0000","last_peered":"2024-09-17T23:05:03.377536+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:03:43.419919+0000","last_became_peered":"2024-09-17T23:03:43.419919+0000","last_unstale":"2024-09-17T23:05:03.377536+0000","last_undegraded":"2024-09-17T23:05:03.377536+0000","last_fullsized":"2024-09-17T23:03:43.419336+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:23:10.447292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"47'2","reported_seq":133,"reported_epoch":84,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:05:03.377179+0000","last_change":"2024-09-17T23:03:38.216030+0000","last_active":"2024-09-17T23:05:03.377179+0000","last_peered":"2024-09-17T23:05:03.377179+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:02:36.205932+0000","last_became_peered":"2024-09-17T23:02:36.205932+0000","last_unstale":"2024-09-17T23:05:03.377179+0000","last_undegraded":"2024-09-17T23:03:37.963691+0000","last_fullsized":"2024-09-17T23:02:36.205433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:27.219119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"47'7","reported_seq":169,"reported_epoch":83,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:05:02.881742+0000","last_change":"2024-09-17T23:02:36.206690+0000","last_active":"2024-09-17T23:05:02.881742+0000","last_peered":"2024-09-17T23:05:02.881742+0000","last_clean":"2024-09-17T23:02:28.601103+0000","last_became_active":"2024-09-17T23:02:36.206690+0000","last_became_peered":"2024-09-17T23:02:36.206690+0000","last_unstale":"2024-09-17T23:05:02.881742+0000","last_undegraded":"2024-09-17T23:02:36.206032+0000","last_fullsized":"2024-09-17T23:02:36.205941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:49:18.666349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098127499999999999,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":13,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":84,"state":"active+undersized","last_fresh":"2024-09-17T23:05:03.377071+0000","last_change":"2024-09-17T23:03:43.419931+0000","last_active":"2024-09-17T23:05:03.377071+0000","last_peered":"2024-09-17T23:05:03.377071+0000","last_clean":"2024-09-17T23:02:25.219675+0000","last_became_active":"2024-09-17T23:03:43.419931+0000","last_became_peered":"2024-09-17T23:03:43.419931+0000","last_unstale":"2024-09-17T23:05:03.377071+0000","last_undegraded":"2024-09-17T23:05:03.377071+0000","last_fullsized":"2024-09-17T23:03:43.419324+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T08:11:37.122490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3],"acting":[3],"avail_no_missing":["3"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"stale+active+undersized","last_fresh":"2024-09-17T23:03:08.303154+0000","last_change":"2024-09-17T23:02:36.204438+0000","last_active":"2024-09-17T23:03:08.303154+0000","last_peered":"2024-09-17T23:03:08.303154+0000","last_clean":"2024-09-17T23:02:28.597949+0000","last_became_active":"2024-09-17T23:02:36.204438+0000","last_became_peered":"2024-09-17T23:02:36.204438+0000","last_unstale":"2024-09-17T23:03:14.328698+0000","last_undegraded":"2024-09-17T23:03:08.303154+0000","last_fullsized":"2024-09-17T23:02:36.203989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:29:19.022828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00038619700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7],"acting":[7],"avail_no_missing":["7"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"51'6","reported_seq":177,"reported_epoch":75,"state":"active+undersized+degraded","last_fresh":"2024-09-17T23:04:47.728377+0000","last_change":"2024-09-17T23:03:43.423198+0000","last_active":"2024-09-17T23:04:47.728377+0000","last_peered":"2024-09-17T23:04:47.728377+0000","last_clean":"2024-09-17T23:03:42.574324+0000","last_became_active":"2024-09-17T23:03:43.423198+0000","last_became_peered":"2024-09-17T23:03:43.423198+0000","last_unstale":"2024-09-17T23:04:47.728377+0000","last_undegraded":"2024-09-17T23:03:43.422693+0000","last_fullsized":"2024-09-17T23:03:43.422600+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T00:45:54.029051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5],"acting":[5],"avail_no_missing":["5"],"object_location_counts":[{"shards":"5","objects":2}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":251,"reported_epoch":83,"state":"peering","last_fresh":"2024-09-17T23:05:02.375834+0000","last_change":"2024-09-17T23:05:03.377592+0000","last_active":"2024-09-17T23:05:03.377592+0000","last_peered":"2024-09-17T23:05:02.375834+0000","last_clean":"2024-09-17T23:02:22.544336+0000","last_became_active":"2024-09-17T23:03:15.332337+0000","last_became_peered":"2024-09-17T23:03:15.332337+0000","last_unstale":"2024-09-17T23:05:02.375834+0000","last_undegraded":"2024-09-17T23:03:15.331270+0000","last_fullsized":"2024-09-17T23:03:15.331175+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":35,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":91,"num_write":17,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":8,"acting":9,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":407793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":983040,"data_stored":413325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,3,4,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":978944,"data_stored":413306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,3,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":991232,"data_stored":418893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31712,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340128,"statfs":{"total":96636764160,"available":96604291072,"internally_reserved":0,"allocated":536576,"data_stored":215095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":221184,"data_stored":73586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574885,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1585152,"data_stored":1009261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:05:09.136 INFO:tasks.thrashosds.thrasher:Setting 2.2 to [3, 7] 2024-09-17T23:05:09.136 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.2', '3', '7'] 2024-09-17T23:05:09.136 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.2 3 7 2024-09-17T23:05:09.193 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:09.191+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:09.240 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:09.240 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:09.249 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:09.334 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:09.332+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:09.392 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:09.392 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:09.395 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:09.393+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:09.400 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:09.448 INFO:teuthology.orchestra.run.smithi005.stderr:set 2.2 pg_upmap mapping to [3,7] 2024-09-17T23:05:09.496 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:09.494+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:09.543 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:09.544 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:09.552 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:09.597 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:09.595+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:09.657 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:09.657 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:09.666 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:09.708 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:09.705+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:09.799 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:09.797+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:09.810 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:09.810 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:09.819 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:09.900 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:09.898+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:09.929 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:09.929 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:09.938 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:10.000 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:09.997+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:10.045 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:10.045 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:10.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:10.138 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:10.135+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:10.201 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:10.201 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:10.202 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:10.198+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:10.210 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:10.310 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:10.300+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:10.361 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:10.361 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:10.370 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:10.414 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:10.411+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:10.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:05:10.478 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:10.478 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:10.487 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:10.503 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:10.501+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:10.603 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:10.601+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:10.636 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:10.637 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:10.646 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:10.705 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:10.702+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:10.708 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:10.759 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:10.759 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:10.768 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:10.810 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:10.808+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:10.831 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:10.832 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:10.832 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:10.832 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:10.849 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:10.849 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:10.866 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:10.866 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:10.884 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:10.884 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:10.901 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:10.902 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:10.906 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:10.906 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:10.906 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:10.904+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:10.914 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:10.914 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:10.915 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:10.915 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:10.915 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:10.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:11.008 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:11.005+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:11.066 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:11.066 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:11.066 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:11.066 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:05:11.066 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:11.075 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:11.116 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:11.114+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:11.208 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:11.205+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:11.218 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:11.219 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:11.219 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:11.219 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:11.227 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:11.309 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:11.306+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:11.330 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:11.330 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:11.330 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:11.330 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:11.330 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:11.339 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:11.410 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:11.408+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:11.443 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:11.443 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:11.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:11.443 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:11.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.443 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 165.20375218199999, 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:11.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:11.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:11.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 164.20225021900001, 2024-09-17T23:05:11.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:05:11.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 163.19637529400001, 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:05:11.457 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.458 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.459 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:05:11.460 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.461 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:11.462 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.463 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.478152402000006, 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.464 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.466 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.467 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:11.468 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.475024724999997, 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:11.469 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:05:11.470 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:05:11.471 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.472 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.473 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.473175695999998, 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.474 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.475 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.476 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:05:11.477 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.478 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.471861615999998, 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.479 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.480 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.483 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.470289082999997, 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:11.484 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.485 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.488 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.231497930000003, 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.489 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:11.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:05:11.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:05:11.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.494 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.230003991000004, 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.228075266999994, 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.500 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:05:11.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.226177168000007, 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.505 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.509 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.225414767999993, 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.510 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:05:11.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:05:11.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 88.240048587000004, 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:11.514 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 88.239921773000006, 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.519 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:11.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:11.523 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 78.238140848, 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.524 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:05:11.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 53.23305259, 2024-09-17T23:05:11.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:11.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.532 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 43.232032611999998, 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.533 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.537 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 38.231121383000001, 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:05:11.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:05:11.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:05:11.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:05:11.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:45 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.2237264269999999, 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091518199999999995, 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.542 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 45 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216474+0000", 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6950000000000001e-06 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216490+0000", 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6109000000000001e-05 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216505+0000", 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-05 2024-09-17T23:05:11.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216513+0000", 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2290000000000003e-06 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216592+0000", 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9078000000000004e-05 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216713+0000", 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000121067 2024-09-17T23:05:11.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.217387+0000", 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067451399999999997 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.546 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:11.548 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:05:11.548 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:11.548 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:11.545+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:11.648 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:11.645+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:11.692 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:11.692 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:11.692 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:11.692 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:11.701 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:11.748 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:11.746+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:11.804 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:11.804 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:11.804 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:11.804 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:11.804 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:11.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:11.853 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:11.851+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:11.950 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:11.948+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:11.956 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:11.956 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:11.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:11.956 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.995347214000006, 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:11.957 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:05:11.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.990150735, 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:11.961 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.964 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.987339606999996, 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.966 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:05:11.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.943707295999999, 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.971 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:05:11.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:05:11.973 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.943366175999998, 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:11.974 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:05:11.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:05:11.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:05:11.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.935966082999997, 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:11.978 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.981 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.800751363000003, 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.982 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:05:11.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:05:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:05:11.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.800450114, 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:11.986 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:05:11.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.750041315000004, 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.990 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:11.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:05:11.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:11.994 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.749724642000004, 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:05:11.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.998 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.742684225000005, 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:05:11.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:05:12.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:05:12.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.002 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.742407858000007, 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:12.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:12.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.006 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 93.739124621000002, 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:12.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:05:12.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:05:12.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:12.010 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:12.011 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:12.011 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:12.056 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:12.053+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:12.131 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:12.131 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:12.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4941.0:26 2.0 2.925b1538 (undecoded) ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e88)", 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 3.9136289639999999, 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.913652227, 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "queued for pg", 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4941", 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.132 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216374+0000", 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3590000000000002e-06 2024-09-17T23:05:12.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216385+0000", 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.145e-05 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216405+0000", 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9568999999999998e-05 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216413+0000", 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5990000000000002e-06 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.134 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.135 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.135 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:12.135 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 1 2024-09-17T23:05:12.135 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:12.141 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:12.151 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:12.149+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:12.253 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:12.250+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:12.290 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:12.291 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:12.291 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:12.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:12.354 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:12.351+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.98445459000001, 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:05:12.408 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.409 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:05:12.410 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:05:12.411 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.412 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.98400767800001, 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.413 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:05:12.414 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.415 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.416 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.96732903700001, 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.417 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:05:12.418 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:05:12.419 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:05:12.420 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.966775367, 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:05:12.421 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.422 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.423 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:05:12.424 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.425 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.96616374300001, 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.426 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.427 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:05:12.428 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:05:12.429 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.96551104400001, 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.430 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:05:12.431 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.432 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.433 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.964974904, 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.434 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:05:12.435 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.436 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.437 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:05:12.438 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.95017170700001, 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:12.439 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.440 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:05:12.441 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:05:12.442 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.949829024, 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.443 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.444 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.445 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.446 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.94925963899999, 2024-09-17T23:05:12.447 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.448 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:05:12.449 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:05:12.450 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.451 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.946779456, 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.452 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.453 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.454 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.455 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.93927599, 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.456 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:05:12.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:05:12.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:05:12.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.938774545, 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.460 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.461 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.462 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.463 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.93613882400001, 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.464 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.465 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:05:12.466 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:05:12.467 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.928281153, 2024-09-17T23:05:12.468 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.469 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:05:12.470 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.471 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.472 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.79017532899999, 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.473 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.474 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.475 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.476 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 170.379358543, 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:12.477 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.478 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.479 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.480 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 169.87552504999999, 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.481 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:05:12.482 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:05:12.483 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.484 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 169.87012393000001, 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:05:12.485 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.486 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.487 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.488 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:12.489 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 94.442425082, 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:12.490 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:05:12.491 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:05:12.492 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:05:12.493 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.494 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:12.495 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:12.496 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:12.493+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:12.596 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:12.593+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:12.643 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:12.643 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:12.643 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:12.643 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:12.652 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:12.697 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:12.694+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:12.798 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:12.795+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:12.799 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:12.799 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:12.800 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:12.800 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:12.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:12.898 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:12.895+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:12.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:05:12.915 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:12.915 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 63.321439036999998, 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:05:12.916 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:12.917 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:05:12.918 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:12.919 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:12.920 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:12.924 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:12.999 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:12.996+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:13.031 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:13.031 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:13.032 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:13.040 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:13.041 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:13.041 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:13.041 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:13.048 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:13.049 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:13.050 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:13.066 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:13.066 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:13.083 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:13.083 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:13.100 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:13.096+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:13.100 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:13.100 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:13.101 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:13.104 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:13.104 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:13.194 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:13.194 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:13.200 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:13.198+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:13.203 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:13.301 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:13.299+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:13.306 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:13.306 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:13.315 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:13.402 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:13.399+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:13.459 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:13.459 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:13.468 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:13.512 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:13.510+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:13.549 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:05:13.571 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:13.571 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:13.580 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:13.622 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:13.620+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:13.704 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:13.701+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:13.725 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:13.725 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:13.733 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:13.805 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:13.802+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:13.837 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:13.837 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:13.846 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:13.906 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:13.904+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:13.949 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:13.949 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:13.957 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:14.042 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:14.040+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:14.102 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:14.102 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:14.108 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:14.106+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:14.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:14.209 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:14.207+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:14.220 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:14.220 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:14.229 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:14.310 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:14.307+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:14.336 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:14.336 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:14.345 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:14.429 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:14.426+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:14.461 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 4] out_osds: [7] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:05:14.462 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:05:14.462 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-17T23:05:14.462 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-09-17T23:05:14.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-09-17T23:05:14.467 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:05:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:14.497 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:14.506 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:14.513 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:14.510+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:14.614 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:14.611+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:14.656 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:14.657 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:14.666 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:14.715 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:14.713+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:14.814 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:14.814 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:14.816 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:14.814+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:14.822 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:14.917 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:14.914+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:14.929 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:14.929 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:14.938 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:15.018 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:15.016+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:15.056 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:15.057 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:15.066 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:15.105 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:15.119 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:15.117+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:15.170 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:15.171 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:15.180 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:15.223 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:15.221+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:15.229 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:15.230 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:15.247 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:15.247 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:15.266 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:15.266 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:15.283 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:15.283 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:15.300 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:15.300 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:15.301 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:15.304 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:15.304 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:15.321 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:15.318+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:15.329 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:15.329 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:15.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:15.329 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:05:15.329 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:15.337 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:15.422 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:15.419+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:15.471 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.1 primary-affinity to 0 (802) 2024-09-17T23:05:15.487 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:15.488 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:15.488 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:15.488 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:15.497 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:15.526 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:15.524+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:15.599 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:15.599 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:15.599 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:15.600 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:15.600 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:15.608 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:15.656 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:15.654+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:15.716 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:15.716 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:15.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:15.716 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:15.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 169.47667526199999, 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:15.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:15.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:15.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 168.47517329900001, 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.723 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:05:15.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:05:15.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:05:15.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 167.469298374, 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.730 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:15.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:05:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:05:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.751075482000005, 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:05:15.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.747947804999995, 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.741 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:05:15.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:05:15.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.746098775999997, 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:05:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.744784695999996, 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:05:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:05:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:05:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.743212162999995, 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:05:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.504421010000002, 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:05:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.766 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:05:15.767 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.502927071000002, 2024-09-17T23:05:15.768 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:15.769 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.770 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.771 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.773 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.774 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.500998347000007, 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.776 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:05:15.777 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:05:15.778 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.779 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.499100248000005, 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:05:15.780 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.781 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.782 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.783 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.784 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 97.498337848000006, 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:05:15.785 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:05:15.786 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:05:15.787 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.788 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 92.512971667000002, 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.789 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.790 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.791 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:15.792 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:15.793 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 92.512844853000004, 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.794 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:15.795 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:15.796 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.797 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.798 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 82.511063927999999, 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.799 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:05:15.800 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:05:15.801 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:05:15.802 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 57.505975669999998, 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.803 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.804 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.805 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:05:15.806 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 47.504955692000003, 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:05:15.807 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.808 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.810 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 42.504044463, 2024-09-17T23:05:15.811 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.812 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.813 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:05:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:05:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:05:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:05:15.816 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:05:15.817 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:45 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 7.4966495069999999, 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091518199999999995, 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:15.818 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 45 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.819 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216474+0000", 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6950000000000001e-06 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216490+0000", 2024-09-17T23:05:15.820 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6109000000000001e-05 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216505+0000", 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-05 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216513+0000", 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2290000000000003e-06 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:15.821 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216592+0000", 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9078000000000004e-05 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216713+0000", 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000121067 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.217387+0000", 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067451399999999997 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.822 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.823 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.823 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:15.823 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:15.823 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:15.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:15.825 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:15.822+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:15.925 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:15.923+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:15.969 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:15.969 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:15.969 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:15.969 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:15.978 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:16.026 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:16.023+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:16.122 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:16.123 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:16.123 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:16.123 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:16.123 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:16.126 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:16.124+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:16.132 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:16.227 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:16.224+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:16.276 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:16.276 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:16.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:16.276 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:16.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.315383120999996, 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.277 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:05:16.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:05:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.310186642000005, 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.281 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.282 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:05:16.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.307375514, 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.286 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:05:16.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.289 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.263743203000004, 2024-09-17T23:05:16.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:05:16.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:05:16.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.263402083000003, 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.298 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.256001990000001, 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:16.299 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:16.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.120787269999994, 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.303 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:05:16.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:05:16.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.120486021000005, 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:05:16.307 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:05:16.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:05:16.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.070077221999995, 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.315 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.069760548999994, 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:16.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.062720131999995, 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.320 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:05:16.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:05:16.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.324 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.062443764999998, 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.325 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:16.329 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 98.059160528000007, 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:16.333 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:16.335 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:16.332+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:16.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:16.435 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:16.432+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4941.0:26 2.0 2.925b1538 (undecoded) ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e88)", 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 8.2379245179999998, 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.237937939, 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "queued for pg", 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:16.456 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4941", 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.457 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216374+0000", 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3590000000000002e-06 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216385+0000", 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.145e-05 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.458 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216405+0000", 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9568999999999998e-05 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216413+0000", 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5990000000000002e-06 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 1 2024-09-17T23:05:16.459 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:16.465 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:16.485 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:05:16.550 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:16.548+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:16.616 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:16.616 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:16.616 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:16.628 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:16.637 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:16.635+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:16.738 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:16.736+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:16.778 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:16.778 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.354785897, 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.779 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:05:16.780 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.781 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.782 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:05:16.783 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.354338985, 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.784 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:05:16.785 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.786 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.787 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.788 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.337660344, 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.789 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.790 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.791 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:05:16.792 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.33710667400001, 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.793 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:16.794 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:05:16.795 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:05:16.796 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.33649505, 2024-09-17T23:05:16.797 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.798 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.799 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:05:16.800 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.801 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.335842351, 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.802 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:05:16.803 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:05:16.804 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:05:16.805 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.33530621099999, 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.806 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.807 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.808 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:05:16.809 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.320503014, 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:05:16.810 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.811 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.812 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.813 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:05:16.814 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.32016033100001, 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.815 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.816 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:05:16.817 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:05:16.818 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.31959094600001, 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.819 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.820 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:16.821 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:05:16.822 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.31711076299999, 2024-09-17T23:05:16.823 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:16.824 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.825 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.826 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.30960729700001, 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.828 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.829 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.830 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.831 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:05:16.832 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.30910585199999, 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:16.833 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.834 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.835 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:05:16.836 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.306470131, 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.837 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:16.838 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:05:16.840 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.841 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.842 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.29861245999999, 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.843 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.844 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.845 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.846 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:16.847 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 175.16050663600001, 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:16.848 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:05:16.849 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.850 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.851 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 174.74968985000001, 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:16.852 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:05:16.853 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:05:16.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.854 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.854 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:05:16.854 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:05:16.854 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.854 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.855 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.856 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 174.24585635700001, 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.857 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:05:16.858 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:05:16.859 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:05:16.860 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.861 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 174.24045523699999, 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.862 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.863 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.864 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.865 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 98.812756389, 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:05:16.866 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:16.867 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.868 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.869 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.870 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.871 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:16.871 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:16.871 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:16.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:16.873 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:16.869+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:16.973 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:16.971+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:17.020 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:17.020 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:17.020 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:17.029 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:17.074 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:17.072+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:17.135 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:17.135 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:17.136 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:17.136 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:17.136 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:17.144 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:17.185 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:17.183+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:17.277 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:17.275+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:17.291 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:17.291 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:17.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:17.291 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:17.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.291 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:05:17.291 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 67.696850216000001, 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:17.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:05:17.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:17.295 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:17.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:17.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:17.296 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:17.296 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:17.300 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:17.306 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:05:17.378 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:17.376+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:17.418 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:17.418 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:17.418 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:17.418 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:17.427 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:17.430 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:17.431 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:17.448 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:17.448 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:17.465 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:17.466 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:17.478 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:17.476+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:17.483 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:05:17.486 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:17.487 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:17.509 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:17.509 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:17.509 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:17.513 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:17.513 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:17.574 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:17.574 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:17.579 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:17.577+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:17.582 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:17.680 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:17.678+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:17.725 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:17.725 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:17.733 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:17.781 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:17.778+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:17.837 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:17.837 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:17.846 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:17.889 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:17.886+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:17.982 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:17.980+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:17.991 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:17.991 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:17.999 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:18.084 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:18.082+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:18.144 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:18.144 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:18.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:18.184 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:18.182+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:18.285 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:18.283+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:18.298 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:18.298 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:18.307 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:18.386 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:18.384+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:18.451 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:18.451 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:18.460 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:18.503 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:18.501+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:18.563 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:18.563 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:18.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:18.616 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:18.614+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:18.689 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:18.686+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:18.692 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:18.692 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:18.701 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:18.790 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:18.788+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:18.850 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:18.850 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:18.859 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:18.890 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:18.888+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:18.965 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:18.966 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:18.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:18.991 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:18.989+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:19.081 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:19.085 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:19.090 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:19.092 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:19.089+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:19.192 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:19.190+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:19.197 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:19.197 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:19.206 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:19.293 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:19.290+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:19.312 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:19.312 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:19.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:19.394 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:19.391+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:19.437 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:19.437 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:19.446 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:19.499 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:05:19.514 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:19.530 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:19.528+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:19.589 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:19.590 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:19.595 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:19.592+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:19.598 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:19.672 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:19.672 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:19.672 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:19.672 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:19.691 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:19.691 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:19.696 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:19.693+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:19.710 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:19.711 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:19.728 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:19.729 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:19.744 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:19.744 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:19.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:19.745 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:05:19.745 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:19.745 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:19.746 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:19.746 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:19.749 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:19.750 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:19.754 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:19.796 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:19.794+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:19.857 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:19.858 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:19.858 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:19.858 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:19.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:19.910 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:19.908+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:19.970 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:19.970 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:19.970 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:19.970 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:19.970 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:19.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:20.020 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:20.018+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:20.099 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:20.096+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:20.125 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:20.125 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:20.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:20.125 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:20.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.125 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 173.885487778, 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.126 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:20.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:20.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 172.88398581499999, 2024-09-17T23:05:20.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:05:20.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 171.87811088999999, 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:20.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:20.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:05:20.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:05:20.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:20.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:05:20.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:05:20.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:05:20.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:05:20.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:05:20.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.159887998, 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:05:20.147 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.151 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.15676032099999, 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:05:20.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:05:20.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:05:20.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:05:20.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:05:20.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:05:20.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:05:20.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:05:20.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:05:20.158 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.158 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.158 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.159 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.159 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:20.159 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.15491129199999, 2024-09-17T23:05:20.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.160 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:20.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.15359721199999, 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.166 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.168 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:05:20.169 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.170 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.15202467899999, 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.171 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.172 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.173 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.174 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.175 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 101.913233526, 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.176 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.177 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:05:20.178 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:05:20.179 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:05:20.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 101.911739587, 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.182 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:05:20.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:05:20.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.187 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 101.909810863, 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.192 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 101.907912764, 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:05:20.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 101.907150364, 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 96.921784183, 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.202 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.206 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 96.921657369000002, 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.207 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:20.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:20.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:20.212 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 86.919876443999996, 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:20.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:05:20.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 61.914788186000003, 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.217 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:05:20.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 51.913768208, 2024-09-17T23:05:20.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.225 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 46.912856978999997, 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:05:20.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:05:20.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:05:20.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:45 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 11.905462023, 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091518199999999995, 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.230 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 45 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216474+0000", 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6950000000000001e-06 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216490+0000", 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6109000000000001e-05 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.232 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216505+0000", 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-05 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216513+0000", 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2290000000000003e-06 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216592+0000", 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9078000000000004e-05 2024-09-17T23:05:20.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216713+0000", 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000121067 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.217387+0000", 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067451399999999997 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.234 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.235 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:20.236 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:20.236 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:20.233+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:20.337 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:20.335+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:20.380 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:20.380 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:20.380 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:20.380 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:20.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:20.438 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:20.436+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:20.486 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 4] out_osds: [7] dead_osds: [1, 7, 2] live_osds: [0, 3, 4, 5, 6] 2024-09-17T23:05:20.486 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:05:20.487 INFO:tasks.thrashosds.thrasher:Reviving osd 7 2024-09-17T23:05:20.487 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T23:05:20.487 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T23:05:20.489 INFO:tasks.ceph.osd.7:Started 2024-09-17T23:05:20.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:05:20.493 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:20.493 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:20.493 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:20.494 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:20.494 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:20.503 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:20.544 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:20.542+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:no valid command found; 10 closest matches: 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:0 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:1 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:2 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:abort 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:assert 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:config diff 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:config diff get 2024-09-17T23:05:20.589 INFO:teuthology.orchestra.run.smithi152.stderr:config get 2024-09-17T23:05:20.590 INFO:teuthology.orchestra.run.smithi152.stderr:config help [] 2024-09-17T23:05:20.590 INFO:teuthology.orchestra.run.smithi152.stderr:config set ... 2024-09-17T23:05:20.590 INFO:teuthology.orchestra.run.smithi152.stderr:admin_socket: invalid command 2024-09-17T23:05:20.591 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T23:05:20.592 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-7, ['dump_ops_in_flight'] 2024-09-17T23:05:20.640 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:20.638+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:20.650 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:20.650 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:20.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:20.650 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:20.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.650 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.688871546, 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:05:20.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:05:20.654 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.683675067, 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:20.655 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.659 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.68086393900001, 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:20.660 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:05:20.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:05:20.663 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.63723162799999, 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:20.664 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:05:20.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:05:20.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.667 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.667 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.667 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:05:20.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:05:20.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:05:20.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.63689050799999, 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.669 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.673 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:05:20.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:05:20.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.673 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.673 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.62949041500001, 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.674 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.494275695, 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.678 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:05:20.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:05:20.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.493974446, 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.682 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.686 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.443565647, 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.690 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.443248974, 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:20.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:05:20.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:05:20.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:05:20.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.436208557, 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.695 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:05:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:05:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:05:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:05:20.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.43593219, 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.700 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:05:20.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 102.432648953, 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:05:20.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:20.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:05:20.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:05:20.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:05:20.709 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.709 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.709 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.709 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:20.709 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:20.709 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:20.710 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:20.713 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:05:20.741 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:20.739+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4941.0:26 2.0 2.925b1538 (undecoded) ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e88)", 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 12.607789156999999, 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 12.607807736, 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "queued for pg", 2024-09-17T23:05:20.826 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4941", 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:20.827 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216374+0000", 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3590000000000002e-06 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216385+0000", 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.145e-05 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:20.828 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216405+0000", 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9568999999999998e-05 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216413+0000", 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5990000000000002e-06 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:20.829 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:20.830 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 1 2024-09-17T23:05:20.830 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:20.834 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:20.878 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:20.876+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:20.942 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:20.942 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:20.942 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:20.942 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:20.940+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:20.951 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:21.043 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:21.041+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:21.100 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.100 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.676350195, 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.101 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:05:21.102 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:05:21.103 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.104 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.675903283, 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.105 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:21.106 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.107 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.108 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:05:21.109 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.659224642, 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:05:21.110 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:21.111 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.112 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:05:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:05:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:05:21.113 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.114 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:05:21.115 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.65867097200001, 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.116 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.117 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.118 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.119 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.65805934799999, 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.120 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.121 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.122 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:05:21.123 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.124 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.657406649, 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.125 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:05:21.126 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.127 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.128 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.65687050899999, 2024-09-17T23:05:21.129 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.130 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.131 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:05:21.132 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:05:21.133 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.64206731199999, 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.134 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.135 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.136 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:05:21.137 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:05:21.138 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.64172462900001, 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.139 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.140 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:05:21.141 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.142 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.143 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.641155244, 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.144 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:05:21.145 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.146 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:05:21.147 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.148 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.63867506099999, 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.149 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.150 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.151 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:05:21.152 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.153 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.63117159500001, 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.154 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.155 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.156 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.157 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.63067014999999, 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:21.158 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.159 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.160 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:05:21.161 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.628034429, 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:05:21.162 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.163 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:05:21.164 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.165 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.166 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.62017675800001, 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:21.167 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.168 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:05:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:05:21.169 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.170 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:05:21.171 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.48207093400001, 2024-09-17T23:05:21.172 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.173 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:05:21.174 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:05:21.175 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.176 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 179.07125414800001, 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:21.177 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:05:21.178 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.179 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.180 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:05:21.181 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 178.56742065500001, 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:21.182 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.183 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:05:21.184 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:05:21.185 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 178.56201953499999, 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.186 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:05:21.187 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:05:21.188 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:05:21.189 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.190 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 103.134320687, 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.191 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.192 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.193 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:05:21.194 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.195 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:21.196 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:21.197 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:21.194+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:21.297 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:21.295+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:21.303 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:21.304 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:21.304 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:21.312 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:21.398 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:21.396+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:21.418 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:21.419 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:21.419 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:21.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:21.499 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:21.497+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 71.940762183999993, 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:05:21.535 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.536 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:05:21.537 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:05:21.538 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:21.539 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:21.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:21.600 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:21.598+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:21.660 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:21.660 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:21.660 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:21.660 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:21.669 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:21.710 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:21.708+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:21.751 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:05:21.803 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:21.801+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:21.813 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:21.813 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:21.813 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:21.813 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:21.813 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:21.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:21.876 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:21.876 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:21.877 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:21.893 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:21.894 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:21.907 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:21.905+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:21.910 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:21.910 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:21.928 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:21.928 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:21.945 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:21.945 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:21.952 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:21.953 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:21.969 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:21.969 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:21.977 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:22.005 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:22.003+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:22.106 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:22.103+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:22.122 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:22.122 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:22.131 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:22.207 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:22.205+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:22.274 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:22.274 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:22.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:22.326 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:22.324+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:22.385 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:22.385 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:22.395 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:22.408 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:22.406+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:22.439 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:22.436+0000 7f6d52729640 -1 Falling back to public interface 2024-09-17T23:05:22.509 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:22.507+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:22.540 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:22.540 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:22.549 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:22.610 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:22.607+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:22.692 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:22.692 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:22.701 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:22.730 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:05:22.745 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:22.743+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:22.805 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:22.805 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:22.812 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:22.810+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:22.813 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:22.913 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:22.911+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:22.927 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:22.927 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:22.936 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:23.014 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:23.011+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:23.043 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:23.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:23.114 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:23.112+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:23.158 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:23.167 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:23.215 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:23.213+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:23.275 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:23.275 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:23.283 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:23.316 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:23.314+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:23.390 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:23.390 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:23.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:23.444 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:23.442+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:23.506 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:23.507 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:23.515 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:23.556 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:23.554+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:23.619 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:23.616+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:23.628 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:23.628 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:23.638 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:23.719 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:05:23.719 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:23.717+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:23.742 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:23.742 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:23.752 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:23.820 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:23.818+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:23.895 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:23.895 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:23.904 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:23.947 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:23.945+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:23.953 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:24.006 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:24.006 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:24.015 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:24.022 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:24.019+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:24.082 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:24.083 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:24.099 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:24.100 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:24.116 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:24.116 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:24.122 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:24.120+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:24.134 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:24.134 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:24.151 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:24.152 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:24.155 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:24.156 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:24.161 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:24.161 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:24.161 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:24.161 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:24.161 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:24.170 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:24.223 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:24.221+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:24.274 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:24.274 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:24.274 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:24.274 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:24.274 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.274 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 178.03474539499999, 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.275 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:24.276 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.277 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.278 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:24.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:24.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.279 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.279 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.279 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:24.279 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:24.280 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.281 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 177.03324343200001, 2024-09-17T23:05:24.282 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.283 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:05:24.284 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:05:24.285 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:05:24.286 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:05:24.287 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:05:24.288 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 176.02736850700001, 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.289 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.290 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.291 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.292 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:24.293 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.294 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.30914561500001, 2024-09-17T23:05:24.295 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.296 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:05:24.297 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:05:24.298 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.299 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.306017938, 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.300 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.301 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.302 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.303 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.304 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.304168909, 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.305 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.306 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.307 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:05:24.308 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:05:24.309 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.302854829, 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:24.310 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.311 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:05:24.312 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:05:24.313 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:05:24.314 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.301282296, 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:24.315 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.316 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:05:24.317 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.318 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:05:24.319 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:24.320 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.062491143, 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.321 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:05:24.322 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.323 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.324 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.325 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.060997204, 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.326 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.327 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.328 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.329 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.331 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.05906847999999, 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.332 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.333 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.334 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.335 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.336 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.05717038100001, 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:05:24.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:05:24.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:05:24.341 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.05640798100001, 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:05:24.342 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:05:24.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:05:24.345 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 101.0710418, 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:24.351 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 101.07091498600001, 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:24.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.353 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.356 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 91.069134061, 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:05:24.360 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 66.064045802999999, 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.361 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 56.063025824999997, 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.365 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 51.062114596000001, 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.369 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:05:24.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:05:24.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:45 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 16.054719639999998, 2024-09-17T23:05:24.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091518199999999995, 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 45 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216474+0000", 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6950000000000001e-06 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216490+0000", 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6109000000000001e-05 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216505+0000", 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-05 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216513+0000", 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2290000000000003e-06 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216592+0000", 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9078000000000004e-05 2024-09-17T23:05:24.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216713+0000", 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000121067 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.217387+0000", 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067451399999999997 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.377 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.378 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:24.379 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:24.380 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:24.376+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:24.479 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:24.477+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:24.525 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:24.525 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:24.525 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:24.525 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:24.534 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:24.618 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:24.616+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:24.677 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:24.677 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:24.677 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:24.677 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:24.681 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:24.679+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:24.686 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:24.782 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:24.780+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:24.831 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:24.831 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:24.831 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:24.831 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:24.831 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.86953227799999, 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:24.832 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.833 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:05:24.834 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.835 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.864335799, 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.836 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.837 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.838 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:05:24.839 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.840 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.841 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.861524671, 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:24.842 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:05:24.844 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.845 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.81789236, 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.846 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:24.847 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.848 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.849 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.850 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.81755124, 2024-09-17T23:05:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:05:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.851 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.852 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:05:24.854 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.855 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.810151147, 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:05:24.856 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.857 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:05:24.858 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:05:24.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.67493642700001, 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:05:24.860 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.861 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:05:24.862 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:05:24.863 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.864 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.674635178, 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.865 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:05:24.866 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.867 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.868 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.62422637900001, 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.869 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.870 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:05:24.871 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:05:24.872 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.62390970600001, 2024-09-17T23:05:24.873 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.874 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.875 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.876 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.877 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.61686928899999, 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.878 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.879 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:05:24.880 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:05:24.881 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.616592922, 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:05:24.882 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.883 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:05:24.884 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:05:24.885 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:24.886 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 106.613309685, 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.887 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:05:24.888 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:05:24.889 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:05:24.890 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:05:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:24.891 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:24.891 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:24.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:24.893 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:24.890+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:24.992 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:24.990+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:25.013 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:25.013 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:25.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.013 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4941.0:26 2.0 2.925b1538 (undecoded) ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e88)", 2024-09-17T23:05:25.013 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:25.013 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 16.794859124999999, 2024-09-17T23:05:25.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 16.794878616999998, 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "queued for pg", 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4941", 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:25.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216374+0000", 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3590000000000002e-06 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216385+0000", 2024-09-17T23:05:25.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.145e-05 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216405+0000", 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9568999999999998e-05 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216413+0000", 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5990000000000002e-06 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.016 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:25.017 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 1 2024-09-17T23:05:25.017 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:25.022 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:25.094 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:25.091+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:25.130 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:25.130 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:25.130 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:25.138 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:25.194 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:25.192+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.82403538400001, 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:05:25.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.82358847200001, 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.253 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.256 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.80690983100001, 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.257 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:05:25.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:05:25.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:25.261 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.806356161, 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:05:25.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.80574453700001, 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.269 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.80509183800001, 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.271 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:05:25.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.804555698, 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.274 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:05:25.275 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:05:25.278 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.78975250100001, 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.279 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:05:25.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.281 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.789409818, 2024-09-17T23:05:25.283 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:25.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:05:25.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:05:25.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.78884043299999, 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.288 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.292 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.78636025, 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.293 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.778856784, 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.300 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.778355339, 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:05:25.302 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:05:25.303 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:05:25.304 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.77571961800001, 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.305 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.306 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.307 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.308 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.767861947, 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.309 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:25.310 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:05:25.311 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:05:25.312 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.62975612299999, 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:05:25.313 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.314 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.315 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.316 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.317 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 183.21893933699999, 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.318 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.319 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.320 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:05:25.321 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 182.71510584399999, 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.322 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:05:25.323 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:05:25.324 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:05:25.325 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 182.70970472400001, 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.326 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:05:25.327 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:05:25.328 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.329 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 107.282005876, 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:05:25.330 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.331 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.332 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:05:25.333 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:05:25.334 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.335 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:25.337 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:25.337 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:25.334+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:25.438 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:25.435+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:25.485 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:25.485 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:25.485 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:25.485 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:25.494 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:25.538 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:25.536+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:25.593 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:05:25.600 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:25.600 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:25.600 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:25.600 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:25.600 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:25.609 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:25.639 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:25.637+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:25.693 INFO:teuthology.orchestra.run.smithi152.stderr:no valid command found; 10 closest matches: 2024-09-17T23:05:25.693 INFO:teuthology.orchestra.run.smithi152.stderr:0 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:1 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:2 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:abort 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:assert 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:bluestore allocator dump block 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:bluestore allocator fragmentation block 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:bluestore allocator fragmentation histogram block [] [] 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:bluestore allocator score block 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:config diff 2024-09-17T23:05:25.694 INFO:teuthology.orchestra.run.smithi152.stderr:admin_socket: invalid command 2024-09-17T23:05:25.696 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T23:05:25.696 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-7, ['dump_ops_in_flight'] 2024-09-17T23:05:25.717 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:05:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:25.717 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 76.123063908000006, 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:25.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:05:25.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:05:25.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:25.721 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:25.727 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:25.734 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:05:25.779 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:25.777+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:25.841 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:25.838+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:25.841 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:25.841 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:25.841 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:25.841 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:25.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:25.941 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:25.938+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:25.994 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:25.994 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:25.995 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:25.995 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:25.995 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:26.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:26.043 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:26.041+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:26.142 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:26.140+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:26.146 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:26.147 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:26.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:26.147 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:05:26.147 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:26.156 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:26.156 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:05:26.243 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:26.241+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:26.281 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:26.281 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:26.298 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:26.298 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:26.302 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:26.303 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:26.303 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:26.303 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:26.311 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:26.315 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:26.315 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:26.332 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:26.332 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:26.348 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:26.349 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:26.352 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:26.353 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:26.356 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:26.353+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:26.415 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:26.415 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:26.423 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:26.465 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:26.462+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:26.545 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:26.543+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:26.567 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:26.567 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:26.576 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:26.647 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:26.644+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:26.680 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:26.680 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:26.688 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:26.722 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:05:26.747 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:26.745+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:26.755 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:26.753+0000 7f6d52729640 -1 osd.7 38 log_to_monitors true 2024-09-17T23:05:26.794 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:26.794 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:26.802 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:26.849 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:26.847+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:26.945 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:26.945 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:26.949 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:26.947+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:26.954 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:27.050 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:27.048+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:27.068 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:27.068 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:27.077 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:27.151 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:27.149+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:27.184 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:27.184 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:27.193 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:27.251 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:27.249+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:27.300 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:27.300 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:27.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:27.352 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:27.350+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:27.415 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:27.416 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:27.424 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:27.453 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:27.451+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:27.554 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:27.552+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:27.571 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:27.571 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:27.580 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:27.655 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:27.652+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:27.728 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:27.728 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:27.738 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:27.763 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:27.761+0000 7f6d464c7640 -1 osd.7 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:05:27.764 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:27.761+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:27.847 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:27.847 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:27.856 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:27.856 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:27.853+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:27.957 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:27.954+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:28.000 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:28.000 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:28.009 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:28.057 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:28.055+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:28.152 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:28.152 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:28.158 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:28.155+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:28.161 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:28.258 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:28.256+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:28.305 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:28.305 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:28.314 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:28.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:28.398 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:28.396+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:28.458 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:28.458 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:28.460 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:28.457+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:28.467 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:28.492 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:28.492 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:28.509 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:28.510 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:28.527 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:28.527 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:28.544 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:28.544 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:28.560 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:28.558+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:28.564 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:28.565 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:28.565 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.7 2024-09-17T23:05:28.568 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:28.569 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:28.614 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 182.37522215300001, 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.615 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.616 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.617 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.618 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:28.619 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:28.620 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 181.37372019, 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:05:28.621 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.622 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.623 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.625 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:28.626 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.627 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 180.367845265, 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:28.628 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.629 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.630 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.631 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:05:28.632 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.633 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~19] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.649622373, 2024-09-17T23:05:28.634 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047056700000000002, 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 4 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.635 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962046+0000", 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962047+0000", 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3200000000000004e-07 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962050+0000", 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.977e-06 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.636 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962057+0000", 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2180000000000002e-06 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962061+0000", 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2409999999999997e-06 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962112+0000", 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0630999999999997e-05 2024-09-17T23:05:28.637 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962196+0000", 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4220000000000003e-05 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.962517+0000", 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032054799999999998 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.638 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.646494696, 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.639 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.640 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:05:28.641 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:28.642 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.643 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.644 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.64464566700001, 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.645 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.646 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.647 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.648 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:11 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.649 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.64333158700001, 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00086182900000000005, 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 11 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.650 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968337+0000", 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968338+0000", 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9899999999999999e-07 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.651 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968342+0000", 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2289999999999997e-06 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968352+0000", 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8309999999999996e-06 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968357+0000", 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5330000000000002e-06 2024-09-17T23:05:28.652 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968405+0000", 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7914999999999998e-05 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.968450+0000", 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4563e-05 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969123+0000", 2024-09-17T23:05:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000673311 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969156+0000", 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3136999999999998e-05 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969199+0000", 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2511e-05 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.654 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:14 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.641759054, 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067444300000000005, 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:28.655 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.656 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969910+0000", 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5799999999999998e-07 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969914+0000", 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3809999999999999e-06 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969921+0000", 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.464e-06 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.657 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969927+0000", 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0460000000000002e-06 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.969957+0000", 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0263000000000001e-05 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.658 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970000+0000", 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2837999999999999e-05 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970516+0000", 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051608100000000005 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970546+0000", 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9731999999999999e-05 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.659 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.970584+0000", 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7880000000000003e-05 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.402967901, 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.660 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.661 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:28.662 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:05:28.663 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:28.664 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:05:28.665 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.666 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.401473962, 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.667 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.668 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.669 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:05:28.670 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:05:28.671 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.672 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.399545238, 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:05:28.673 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:05:28.674 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:05:28.675 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.677 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:24 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch unwatch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.397647139, 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060938699999999997, 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:05:28.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214021+0000", 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214022+0000", 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0100000000000005e-07 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214025+0000", 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.48e-06 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214031+0000", 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0179999999999998e-06 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214034+0000", 2024-09-17T23:05:28.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4020000000000002e-06 2024-09-17T23:05:28.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214060+0000", 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6047e-05 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214101+0000", 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0876e-05 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214545+0000", 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044454999999999999 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214575+0000", 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9393000000000001e-05 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214631+0000", 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6020000000000002e-05 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.685 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.396884739, 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:05:28.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:05:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:05:28.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 105.411518558, 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.690 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:28.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:28.695 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 105.411391744, 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.696 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:28.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.701 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:32 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 95.409610818999994, 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000420729, 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.702 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 32 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202058+0000", 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5799999999999999e-07 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202063+0000", 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8740000000000003e-06 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202070+0000", 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202079+0000", 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8899999999999996e-06 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202217+0000", 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013817699999999999 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202316+0000", 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9160000000000006e-05 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:53.202479+0000", 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016236899999999999 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:37 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 70.404522560999993, 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00076670700000000004, 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.706 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 37 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207146+0000", 2024-09-17T23:05:28.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207149+0000", 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207162+0000", 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3217000000000001e-05 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207197+0000", 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4260000000000001e-05 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207214+0000", 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7070000000000001e-05 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207700+0000", 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048605399999999998 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207789+0000", 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8875000000000005e-05 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:18.207913+0000", 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012406799999999999 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:39 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66)", 2024-09-17T23:05:28.710 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 60.403502582999998, 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059245299999999995, 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 39 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.711 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208166+0000", 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208168+0000", 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4899999999999999e-06 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208174+0000", 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9789999999999998e-06 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208203+0000", 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9490000000000001e-05 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208213+0000", 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8630000000000003e-06 2024-09-17T23:05:28.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208489+0000", 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027607800000000002 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208593+0000", 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000104011 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:28.208758+0000", 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016554199999999999 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:40 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 55.402591354000002, 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051659199999999996, 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.715 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 40 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209077+0000", 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209079+0000", 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-06 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209084+0000", 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3929999999999999e-06 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209097+0000", 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3081000000000001e-05 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209107+0000", 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6809999999999993e-06 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209419+0000", 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031241500000000002 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.718 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209492+0000", 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.224e-05 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:04:33.209594+0000", 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102333 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.719 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:45 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 20.395196398, 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091518199999999995, 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:28.720 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 45 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216474+0000", 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6950000000000001e-06 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216490+0000", 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6109000000000001e-05 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216505+0000", 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-05 2024-09-17T23:05:28.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216513+0000", 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2290000000000003e-06 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216592+0000", 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9078000000000004e-05 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216713+0000", 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000121067 2024-09-17T23:05:28.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.217387+0000", 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067451399999999997 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:28.724 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:28.726 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:28.726 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:28.723+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:28.731 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-17T23:05:28.728+0000 7f23a7fff640 0 -- 172.21.15.5:0/778549171 >> [v2:172.21.15.5:6800/3261733059,v1:172.21.15.5:6801/3261733059] conn(0x7f23800048b0 msgr2=0x7f2380006d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:28.738 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:05:28.826 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:28.824+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:28.872 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:28.872 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:28.872 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:28.872 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:28.881 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:28.965 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:28.963+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:29.024 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:29.024 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:29.024 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:29.025 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:29.025 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:29.028 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:29.026+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:29.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:29.129 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:29.127+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:29.178 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.21746930800001, 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018369099999999999, 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.179 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958638+0000", 2024-09-17T23:05:29.180 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958640+0000", 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.885e-06 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958656+0000", 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5464e-05 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958666+0000", 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0400999999999999e-05 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958676+0000", 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0335e-05 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958738+0000", 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1661999999999993e-05 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.182 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.958822+0000", 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3943999999999995e-05 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.212272829, 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.183 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:29.184 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:05:29.185 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:29.186 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:05:29.187 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:8 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.209461701, 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012870899999999999, 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.188 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 8 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966646+0000", 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.189 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966647+0000", 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7400000000000002e-07 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966652+0000", 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6529999999999999e-06 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966663+0000", 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0208e-05 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.190 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966668+0000", 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1760000000000001e-06 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966707+0000", 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9273000000000002e-05 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966775+0000", 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7525000000000001e-05 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.191 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.16582939, 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000190767, 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:29.192 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010278+0000", 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.193 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010279+0000", 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010283+0000", 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2189999999999998e-06 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010290+0000", 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0299999999999996e-06 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.194 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010299+0000", 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010339+0000", 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9864000000000003e-05 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.195 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010395+0000", 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6159999999999998e-05 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010469+0000", 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4025999999999999e-05 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.196 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.16548827, 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.197 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:05:29.199 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:05:29.200 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.201 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:12 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.158088177, 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013072600000000001, 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.202 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018019+0000", 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018020+0000", 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7800000000000001e-07 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.203 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018025+0000", 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8369999999999996e-06 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018036+0000", 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0553999999999999e-05 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018041+0000", 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3489999999999999e-06 2024-09-17T23:05:29.204 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018083+0000", 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2163000000000003e-05 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.018150+0000", 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7045000000000006e-05 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.205 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.022873457, 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018225399999999999, 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.206 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153234+0000", 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153235+0000", 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6899999999999996e-07 2024-09-17T23:05:29.207 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153245+0000", 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0098000000000001e-05 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153253+0000", 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4229999999999999e-06 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153260+0000", 2024-09-17T23:05:29.208 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153301+0000", 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0796e-05 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153348+0000", 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7095000000000002e-05 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.209 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153416+0000", 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8713000000000004e-05 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4929.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 111.022572208, 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000207801, 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:29.210 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4929", 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1383657882", 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153535+0000", 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.211 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153536+0000", 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8400000000000005e-07 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153539+0000", 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5830000000000001e-06 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.212 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153545+0000", 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153549+0000", 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.907e-06 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153583+0000", 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4703999999999998e-05 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.213 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153632+0000", 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8958000000000001e-05 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.153743+0000", 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000110865 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:1 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:29.214 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.972163409, 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00018248200000000001, 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:29.215 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203944+0000", 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203945+0000", 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6599999999999996e-07 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.216 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203955+0000", 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0111e-05 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203962+0000", 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4220000000000003e-06 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.203967+0000", 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0340000000000004e-06 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.217 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204008+0000", 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0383000000000003e-05 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204056+0000", 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7886000000000002e-05 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204127+0000", 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0980000000000001e-05 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.218 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.971846736, 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00020284099999999999, 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:29.219 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204261+0000", 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.220 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204262+0000", 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204265+0000", 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.534e-06 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204271+0000", 2024-09-17T23:05:29.221 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.229e-06 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204275+0000", 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7790000000000002e-06 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204309+0000", 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3791999999999998e-05 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.222 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204357+0000", 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7652999999999999e-05 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.204464+0000", 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107185 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.223 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:16 2.6 2:67cae2ed:::rbd_mirroring:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.964806319, 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014672900000000001, 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 16 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.224 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211301+0000", 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211302+0000", 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6499999999999998e-07 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.225 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211307+0000", 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2249999999999999e-06 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211318+0000", 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0865e-05 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211324+0000", 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5199999999999997e-06 2024-09-17T23:05:29.226 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211370+0000", 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6638999999999998e-05 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211448+0000", 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7614999999999995e-05 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:18 2.6 2:67cae2ed:::rbd_mirroring:head [call rbd.mirror_image_get in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.96452995200001, 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014136300000000001, 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 18 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.228 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211578+0000", 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211579+0000", 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4399999999999998e-07 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211584+0000", 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3759999999999999e-06 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211597+0000", 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2593e-05 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.230 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211605+0000", 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0269999999999995e-06 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211646+0000", 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1792000000000002e-05 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211719+0000", 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2631000000000003e-05 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.231 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.961246715, 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.232 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:05:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.234 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:29.235 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:05:29.236 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:05:29.236 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.236 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.236 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.236 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:29.236 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:29.236 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:29.237 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:29.235+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:29.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:29.338 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:29.336+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:29.346 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4941.0:26 2.0 2.925b1538 (undecoded) ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e88)", 2024-09-17T23:05:29.346 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 21.128459937999999, 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 21.128474933, 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "waiting for peered", 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4941", 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.347 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216374+0000", 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3590000000000002e-06 2024-09-17T23:05:29.348 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216385+0000", 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.145e-05 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216405+0000", 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9568999999999998e-05 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.349 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216413+0000", 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5990000000000002e-06 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.729688+0000", 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 20.513274776999999 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "waiting for peered", 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.729701+0000", 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.314e-05 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.350 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4941.0:26 2.0 2.925b1538 (undecoded) ondisk+retry+write+known_if_redirected+full_try+full_force+supports_pool_eio e99)", 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:28.730521+0000", 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.61431048499999996, 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.61437355800000004, 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "waiting for peered", 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4941", 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.351 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.730521+0000", 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.730521+0000", 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.730522+0000", 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.449e-06 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.352 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.730529+0000", 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8290000000000002e-06 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.730537+0000", 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4689999999999997e-06 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.730545+0000", 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.011e-06 2024-09-17T23:05:29.353 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.730592+0000", 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6378999999999998e-05 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "waiting for peered", 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.730598+0000", 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6490000000000002e-06 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-09-17T23:05:29.354 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 2 2024-09-17T23:05:29.355 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:29.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:29.440 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:29.437+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:29.502 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:29.502 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:29.502 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:29.511 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:29.540 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:29.538+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:29.620 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:29.620 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:29.620 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:29.620 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:29.620 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.620 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.19646290099999, 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00099517300000000002, 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.621 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420623+0000", 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420624+0000", 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8800000000000002e-07 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420778+0000", 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015409700000000001 2024-09-17T23:05:29.622 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420792+0000", 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3380999999999999e-05 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420797+0000", 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6459999999999998e-06 2024-09-17T23:05:29.623 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420853+0000", 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5600000000000003e-05 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.420871+0000", 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8423e-05 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421574+0000", 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00070226200000000005 2024-09-17T23:05:29.624 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421619+0000", 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4975999999999998e-05 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.625 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:21 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'11, mlcod=16'8)", 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.19601598899999, 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0009874529999999999, 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.626 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421070+0000", 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421071+0000", 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.99e-07 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421179+0000", 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010771499999999999 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.627 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421189+0000", 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0219e-05 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421193+0000", 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.532e-06 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421246+0000", 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2967000000000003e-05 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.628 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.421267+0000", 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0474000000000001e-05 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422011+0000", 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074415600000000005 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.422058+0000", 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6791e-05 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.629 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:31 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'17, mlcod=16'14)", 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.17933734799999, 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010422630000000001, 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.630 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437749+0000", 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437750+0000", 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7999999999999993e-07 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437771+0000", 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0687999999999999e-05 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437785+0000", 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4834000000000001e-05 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437794+0000", 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.157e-06 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437853+0000", 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9657999999999997e-05 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.437867+0000", 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4280999999999999e-05 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438759+0000", 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000891229 2024-09-17T23:05:29.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438791+0000", 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2435999999999999e-05 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:32 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'18, mlcod=16'14)", 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.178783678, 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001018836, 2024-09-17T23:05:29.634 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438303+0000", 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6899999999999997e-07 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438382+0000", 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8807999999999995e-05 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438402+0000", 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9853000000000001e-05 2024-09-17T23:05:29.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438409+0000", 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2239999999999998e-06 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438458+0000", 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8479999999999997e-05 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438473+0000", 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5537999999999999e-05 2024-09-17T23:05:29.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439289+0000", 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081555799999999997 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439321+0000", 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2706000000000002e-05 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.638 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.17817205399999, 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096088300000000005, 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438914+0000", 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438915+0000", 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8999999999999996e-07 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438920+0000", 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2460000000000003e-06 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438930+0000", 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0298e-05 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438935+0000", 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7099999999999998e-06 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.641 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.438989+0000", 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4126000000000003e-05 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439010+0000", 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0885000000000001e-05 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439838+0000", 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00082748700000000001 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439875+0000", 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7441000000000003e-05 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:34 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'20, mlcod=16'15)", 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.17751935499999, 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000986399, 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.643 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439567+0000", 2024-09-17T23:05:29.644 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9299999999999998e-07 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439572+0000", 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3649999999999997e-06 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439584+0000", 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1693e-05 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439588+0000", 2024-09-17T23:05:29.645 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6040000000000003e-06 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439631+0000", 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2412e-05 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.439645+0000", 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4814000000000001e-05 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440521+0000", 2024-09-17T23:05:29.646 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00087564100000000003 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440553+0000", 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2277000000000003e-05 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:35 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'21, mlcod=16'15)", 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.17698321500001, 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0010411909999999999, 2024-09-17T23:05:29.647 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440103+0000", 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440104+0000", 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440158+0000", 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4848000000000001e-05 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.649 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440169+0000", 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0676000000000001e-05 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440174+0000", 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2560000000000002e-06 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440212+0000", 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7812999999999999e-05 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.440225+0000", 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2490000000000001e-05 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441116+0000", 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089149900000000002 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.441144+0000", 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8e-05 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:53 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'31, mlcod=16'29)", 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.16218001799999, 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094995699999999997, 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454906+0000", 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454908+0000", 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.77e-06 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454919+0000", 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1372999999999999e-05 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454947+0000", 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7372000000000002e-05 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.454972+0000", 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5040000000000001e-05 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455111+0000", 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013911699999999999 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455151+0000", 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9703000000000003e-05 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.655 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455806+0000", 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00065574299999999997 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455856+0000", 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9839000000000002e-05 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:54 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'32, mlcod=16'29)", 2024-09-17T23:05:29.656 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.161837335, 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011246800000000001, 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:29.657 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455249+0000", 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0500000000000004e-07 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455253+0000", 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9310000000000001e-06 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455261+0000", 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9459999999999998e-06 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455265+0000", 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0369999999999996e-06 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455454+0000", 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000188968 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.659 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455475+0000", 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0505000000000001e-05 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456329+0000", 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00085371899999999996 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456374+0000", 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5068999999999998e-05 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.660 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:55 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'33, mlcod=16'29)", 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.16126795, 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00094237900000000002, 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:29.661 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455818+0000", 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455819+0000", 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9999999999999996e-07 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455898+0000", 2024-09-17T23:05:29.662 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9326999999999995e-05 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455909+0000", 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0991e-05 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455916+0000", 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7009999999999999e-06 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455978+0000", 2024-09-17T23:05:29.663 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1789000000000001e-05 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.455991+0000", 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3376e-05 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456728+0000", 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00073674600000000004 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.664 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.456761+0000", 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2648999999999999e-05 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:58 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'36, mlcod=16'33)", 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.15878776700001, 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055046, 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458298+0000", 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458299+0000", 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.666 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458429+0000", 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00013032699999999999 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458442+0000", 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2343e-05 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458448+0000", 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7070000000000003e-06 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458517+0000", 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.86e-05 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.458533+0000", 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6237000000000001e-05 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459305+0000", 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00077141799999999995 2024-09-17T23:05:29.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.459354+0000", 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8857000000000003e-05 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.151284301, 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001123013, 2024-09-17T23:05:29.669 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465802+0000", 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6600000000000002e-07 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465806+0000", 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0890000000000002e-06 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465825+0000", 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.8873999999999999e-05 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465831+0000", 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4389999999999999e-06 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465878+0000", 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6969999999999999e-05 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.465898+0000", 2024-09-17T23:05:29.672 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9788000000000001e-05 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466862+0000", 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000964013 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466925+0000", 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3373999999999993e-05 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.673 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.15078285600001, 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001109259, 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466303+0000", 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466304+0000", 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5700000000000002e-07 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466355+0000", 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0825999999999998e-05 2024-09-17T23:05:29.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466366+0000", 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1172000000000001e-05 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466373+0000", 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7490000000000001e-06 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466424+0000", 2024-09-17T23:05:29.676 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1456000000000003e-05 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.466449+0000", 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4861000000000001e-05 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467369+0000", 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00091962900000000004 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.677 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.467413+0000", 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4008999999999998e-05 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.14814713499999, 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00096087099999999997, 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.678 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468939+0000", 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468940+0000", 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.679 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.468993+0000", 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3757e-05 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469003+0000", 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3300000000000005e-06 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469007+0000", 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.155e-06 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.680 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469051+0000", 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3674000000000002e-05 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469064+0000", 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.328e-05 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469870+0000", 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080585800000000001 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.681 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.469900+0000", 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0286000000000001e-05 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:84 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'54, mlcod=16'50)", 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.14028946400001, 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000897268, 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476797+0000", 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4099999999999999e-07 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476857+0000", 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9531999999999999e-05 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476867+0000", 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.7759999999999992e-06 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476871+0000", 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7350000000000004e-06 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476916+0000", 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4285e-05 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.476935+0000", 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9579e-05 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477660+0000", 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072492800000000001 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.477694+0000", 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3892e-05 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:99 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'65, mlcod=16'63)", 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 188.00218364, 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00092496699999999996, 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.686 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614903+0000", 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614909+0000", 2024-09-17T23:05:29.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.754e-06 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614943+0000", 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4048999999999999e-05 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.614980+0000", 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6569000000000002e-05 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615023+0000", 2024-09-17T23:05:29.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3049000000000001e-05 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615131+0000", 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000107855 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615150+0000", 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9199e-05 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615794+0000", 2024-09-17T23:05:29.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00064345600000000004 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:21.615828+0000", 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4035999999999997e-05 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:134 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'92, mlcod=16'87)", 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 187.591366854, 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011259900000000001, 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.690 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025719+0000", 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025720+0000", 2024-09-17T23:05:29.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4400000000000001e-07 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025789+0000", 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8977e-05 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025797+0000", 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4190000000000002e-06 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.692 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025803+0000", 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5910000000000003e-06 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025850+0000", 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6848000000000003e-05 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.025864+0000", 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4364e-05 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026816+0000", 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00095193100000000004 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.026845+0000", 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9416000000000001e-05 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:148 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'106, mlcod=16'104)", 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:29.694 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 187.087533361, 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00090620299999999996, 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529553+0000", 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529555+0000", 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.543e-06 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529573+0000", 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7303e-05 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529606+0000", 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3253000000000002e-05 2024-09-17T23:05:29.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529622+0000", 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.5563e-05 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529767+0000", 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014550699999999999 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.529822+0000", 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4653e-05 2024-09-17T23:05:29.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530420+0000", 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00059815200000000002 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.530459+0000", 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9229e-05 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_repop(client.4195.0:158 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'107)", 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 187.08213224100001, 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00089648099999999997, 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.699 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534954+0000", 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.534955+0000", 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5600000000000005e-07 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.700 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535024+0000", 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9778999999999997e-05 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535036+0000", 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1664e-05 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535042+0000", 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9270000000000002e-06 2024-09-17T23:05:29.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535086+0000", 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3708000000000002e-05 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535096+0000", 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0502999999999999e-05 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535823+0000", 2024-09-17T23:05:29.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00072635099999999997 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:02:22.535850+0000", 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7892999999999999e-05 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4908.0:5 2.4 2:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 111.65443339300001, 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001133078, 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:29.703 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4908", 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 5 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:29.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962653+0000", 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962655+0000", 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.796e-06 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962674+0000", 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9253999999999999e-05 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:29.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962693+0000", 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9570000000000001e-05 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962703+0000", 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4800000000000007e-06 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962757+0000", 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4524000000000002e-05 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.962867+0000", 2024-09-17T23:05:29.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010961800000000001 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963628+0000", 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00076128899999999995 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963689+0000", 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1068999999999994e-05 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:03:37.963786+0000", 2024-09-17T23:05:29.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6477999999999993e-05 2024-09-17T23:05:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:29.708 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:29.708 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:29.709 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:29.710 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:29.707+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:29.733 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:05:29.810 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:29.808+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:29.820 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:29.820 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:29.821 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:29.821 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:29.829 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:29.910 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:29.908+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:29.936 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:29.936 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:29.936 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:29.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:30.029 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:30.027+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:30.091 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:30.091 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:30.091 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4201.0:4 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 80.497304205000006, 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000197634, 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4201", 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.152:0/2407500907", 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 4 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:30.092 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592565+0000", 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592567+0000", 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.7889999999999999e-06 2024-09-17T23:05:30.093 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592573+0000", 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2559999999999999e-06 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592585+0000", 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1651000000000001e-05 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592595+0000", 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0434e-05 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:30.094 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592677+0000", 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2134999999999999e-05 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:04:09.592763+0000", 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5369000000000002e-05 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:30.095 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:30.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:30.147 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:30.145+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:30.213 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:30.211+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:30.217 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:30.218 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:30.218 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:30.218 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:30.226 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:30.314 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:30.311+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:30.372 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:30.372 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:30.372 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:30.372 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:30.372 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:30.381 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:30.423 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:30.420+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:30.515 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:30.513+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:30.526 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:30.526 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:30.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:30.526 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [] 2024-09-17T23:05:30.526 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:30.535 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:30.570 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:05:30.616 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:30.613+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:30.637 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:30.637 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:30.638 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:30.638 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:30.646 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:30.697 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:05:30.733 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:30.733 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:30.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:30.734 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:30.734 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:30.735 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:30.733+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:30.749 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:30.749 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:30.751 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:30.751 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:30.762 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:30.766 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:30.767 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:30.784 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:05:30.784 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-09-17T23:05:30.787 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:30.788 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:30.841 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:30.842 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:30.842 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:30.840+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:30.907 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:30.907 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:30.915 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:30.938 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:30.936+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:30.944 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd info testrbdjournal53757 --format=xml 2024-09-17T23:05:30.944 INFO:tasks.workunit.client.0.smithi005.stderr:+ expect_false xmlstarlet sel -t -v //image/journal 2024-09-17T23:05:30.944 INFO:tasks.workunit.client.0.smithi005.stderr:+ set -x 2024-09-17T23:05:30.945 INFO:tasks.workunit.client.0.smithi005.stderr:+ xmlstarlet sel -t -v //image/journal 2024-09-17T23:05:30.989 INFO:tasks.workunit.client.0.smithi005.stderr:+ return 0 2024-09-17T23:05:30.989 INFO:tasks.workunit.client.0.smithi005.stderr:+ expect_false rbd journal info 132cc2a15bff 2024-09-17T23:05:30.989 INFO:tasks.workunit.client.0.smithi005.stderr:+ set -x 2024-09-17T23:05:30.989 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal info 132cc2a15bff 2024-09-17T23:05:31.021 INFO:tasks.workunit.client.0.smithi005.stderr:failed to get journal metadata: (2) No such file or directory 2024-09-17T23:05:31.021 INFO:tasks.workunit.client.0.smithi005.stderr:rbd: journal info: (2) No such file or directory 2024-09-17T23:05:31.022 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:31.022 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:31.024 INFO:tasks.workunit.client.0.smithi005.stderr:+ return 0 2024-09-17T23:05:31.024 INFO:tasks.workunit.client.0.smithi005.stderr:+ expect_false rbd journal info --image testrbdjournal53757 2024-09-17T23:05:31.024 INFO:tasks.workunit.client.0.smithi005.stderr:+ set -x 2024-09-17T23:05:31.024 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal info --image testrbdjournal53757 2024-09-17T23:05:31.031 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:31.069 INFO:tasks.workunit.client.0.smithi005.stderr:rbd: journaling is not enabled for image testrbdjournal53757 2024-09-17T23:05:31.072 INFO:tasks.workunit.client.0.smithi005.stderr:+ return 0 2024-09-17T23:05:31.072 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd feature enable testrbdjournal53757 journaling 2024-09-17T23:05:31.075 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:31.073+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:31.129 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd info testrbdjournal53757 --format=xml 2024-09-17T23:05:31.129 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //image/journal 2024-09-17T23:05:31.138 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:31.139 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:31.139 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:31.137+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:31.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:31.181 INFO:tasks.workunit.client.0.smithi005.stderr:+ local journal1=132cc2a15bff 2024-09-17T23:05:31.181 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 132cc2a15bff = 132cc2a15bff 2024-09-17T23:05:31.181 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal info 132cc2a15bff 2024-09-17T23:05:31.215 INFO:tasks.workunit.client.0.smithi005.stdout:rbd journal '132cc2a15bff': 2024-09-17T23:05:31.215 INFO:tasks.workunit.client.0.smithi005.stdout: header_oid: journal.132cc2a15bff 2024-09-17T23:05:31.215 INFO:tasks.workunit.client.0.smithi005.stdout: object_oid_prefix: journal_data.2.132cc2a15bff. 2024-09-17T23:05:31.215 INFO:tasks.workunit.client.0.smithi005.stdout: order: 24 (16 MiB objects) 2024-09-17T23:05:31.215 INFO:tasks.workunit.client.0.smithi005.stdout: splay_width: 4 2024-09-17T23:05:31.217 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal status 132cc2a15bff 2024-09-17T23:05:31.239 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:31.237+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:31.252 INFO:tasks.workunit.client.0.smithi005.stdout:minimum_set: 0 2024-09-17T23:05:31.252 INFO:tasks.workunit.client.0.smithi005.stdout:active_set: 0 2024-09-17T23:05:31.252 INFO:tasks.workunit.client.0.smithi005.stdout:registered clients: 2024-09-17T23:05:31.252 INFO:tasks.workunit.client.0.smithi005.stdout: [id=, commit_position=[positions=[]], state=connected] 2024-09-17T23:05:31.254 INFO:tasks.workunit.client.0.smithi005.stderr:+ local count=10 2024-09-17T23:05:31.255 INFO:tasks.workunit.client.0.smithi005.stderr:+ save_commit_position 132cc2a15bff 2024-09-17T23:05:31.255 INFO:tasks.workunit.client.0.smithi005.stderr:+ local journal=132cc2a15bff 2024-09-17T23:05:31.255 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p rbd getomapval journal.132cc2a15bff client_ /tmp/rbd_journal53757/132cc2a15bff.client_.omap 2024-09-17T23:05:31.291 INFO:tasks.workunit.client.0.smithi005.stderr:Writing to /tmp/rbd_journal53757/132cc2a15bff.client_.omap 2024-09-17T23:05:31.293 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:31.293 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:31.294 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd bench --io-type write testrbdjournal53757 --io-size 4096 --io-threads 1 --io-total 40960 --io-pattern seq 2024-09-17T23:05:31.302 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:05:31.343 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:31.341+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:31.355 INFO:tasks.workunit.client.0.smithi005.stdout:bench type write io_size 4096 io_threads 1 bytes 40960 pattern sequential 2024-09-17T23:05:31.362 INFO:tasks.workunit.client.0.smithi005.stdout: SEC OPS OPS/SEC BYTES/SEC 2024-09-17T23:05:31.362 INFO:tasks.workunit.client.0.smithi005.stdout:elapsed: 0 ops: 10 ops/sec: 1250.03 bytes/sec: 4.9 MiB/s 2024-09-17T23:05:31.372 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal status --image testrbdjournal53757 2024-09-17T23:05:31.372 INFO:tasks.workunit.client.0.smithi005.stderr:+ fgrep tid=9 2024-09-17T23:05:31.424 INFO:tasks.workunit.client.0.smithi005.stdout: [id=, commit_position=[positions=[[object_number=3, tag_tid=1, entry_tid=11], [object_number=2, tag_tid=1, entry_tid=10], [object_number=1, tag_tid=1, entry_tid=9], [object_number=0, tag_tid=1, entry_tid=8]]], state=connected] 2024-09-17T23:05:31.425 INFO:tasks.workunit.client.0.smithi005.stderr:+ restore_commit_position 132cc2a15bff 2024-09-17T23:05:31.425 INFO:tasks.workunit.client.0.smithi005.stderr:+ local journal=132cc2a15bff 2024-09-17T23:05:31.425 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p rbd setomapval journal.132cc2a15bff client_ 2024-09-17T23:05:31.441 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:31.439+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:31.450 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:31.450 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:31.460 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:05:31.463 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal status --image testrbdjournal53757 2024-09-17T23:05:31.464 INFO:tasks.workunit.client.0.smithi005.stderr:+ fgrep 'positions=[]' 2024-09-17T23:05:31.518 INFO:tasks.workunit.client.0.smithi005.stdout: [id=, commit_position=[positions=[]], state=connected] 2024-09-17T23:05:31.518 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd journal inspect --verbose 132cc2a15bff 2024-09-17T23:05:31.518 INFO:tasks.workunit.client.0.smithi005.stderr:++ grep -c 'event_type.*AioWrite' 2024-09-17T23:05:31.542 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:31.539+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:31.560 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-17T23:05:31.557+0000 7f421ced3640 -1 JournalMetadata: 0x55e7dd184640 failed to locate client: INSPECT 2024-09-17T23:05:31.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ local count1=10 2024-09-17T23:05:31.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 10 -eq 10 2024-09-17T23:05:31.563 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal export 132cc2a15bff /tmp/rbd_journal53757/journal.export 2024-09-17T23:05:31.603 INFO:tasks.workunit.client.0.smithi005.stdout:12 entries processed, 0 errors 2024-09-17T23:05:31.605 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-17T23:05:31.603+0000 7fe668843640 -1 JournalMetadata: 0x55af6eb902b0 failed to locate client: EXPORT 2024-09-17T23:05:31.608 INFO:tasks.workunit.client.0.smithi005.stderr:++ stat -c %s /tmp/rbd_journal53757/journal.export 2024-09-17T23:05:31.608 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:31.608 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:31.609 INFO:tasks.workunit.client.0.smithi005.stderr:+ local size=55926 2024-09-17T23:05:31.609 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 55926 -gt 0 2024-09-17T23:05:31.609 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd export testrbdjournal53757 /tmp/rbd_journal53757/testrbdjournal53757.export 2024-09-17T23:05:31.617 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:05:31.661 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:31.659+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:31.676 INFO:tasks.workunit.client.0.smithi005.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T23:05:31.681 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image1=testrbdjournal537571 2024-09-17T23:05:31.682 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd create --image-feature exclusive-lock --image-feature journaling --size 128 testrbdjournal537571 2024-09-17T23:05:31.722 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:31.722 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:31.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:31.739 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd info testrbdjournal537571 --format=xml 2024-09-17T23:05:31.739 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //image/journal 2024-09-17T23:05:31.743 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:31.741+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:31.749 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:05:31.794 INFO:tasks.workunit.client.0.smithi005.stderr:+ journal1=14d56a47625e 2024-09-17T23:05:31.794 INFO:tasks.workunit.client.0.smithi005.stderr:+ save_commit_position 14d56a47625e 2024-09-17T23:05:31.794 INFO:tasks.workunit.client.0.smithi005.stderr:+ local journal=14d56a47625e 2024-09-17T23:05:31.794 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p rbd getomapval journal.14d56a47625e client_ /tmp/rbd_journal53757/14d56a47625e.client_.omap 2024-09-17T23:05:31.833 INFO:tasks.workunit.client.0.smithi005.stderr:Writing to /tmp/rbd_journal53757/14d56a47625e.client_.omap 2024-09-17T23:05:31.836 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal import --dest testrbdjournal537571 /tmp/rbd_journal53757/journal.export 2024-09-17T23:05:31.844 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:31.842+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:31.846 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:31.846 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:31.855 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:31.898 INFO:tasks.workunit.client.0.smithi005.stdout:12 entries processed, 0 errors 2024-09-17T23:05:31.898 INFO:tasks.workunit.client.0.smithi005.stdout:Waiting for journal append to complete... 2024-09-17T23:05:31.905 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-17T23:05:31.903+0000 7fc6fb7fe640 -1 JournalMetadata: 0x560632b3eb90 failed to locate client: IMPORT 2024-09-17T23:05:31.909 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd snap create testrbdjournal537571@test 2024-09-17T23:05:31.946 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:31.943+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:31.979 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:31.979 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:31.989 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:32.073 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:32.071+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:32.136 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:32.136 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:32.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:32.186 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:32.184+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:32.248 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:32.246+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:32.293 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:32.293 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:32.301 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:32.349 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:32.346+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:32.408 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:32.408 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:32.417 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:32.450 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:32.447+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:32.524 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:32.524 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:32.533 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:32.580 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:32.578+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:32.643 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:32.643 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:32.652 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:32.652 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:32.650+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:32.739 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:05:32.753 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:32.751+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:32.755 INFO:tasks.workunit.client.0.smithi005.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T23:05:32.763 INFO:tasks.workunit.client.0.smithi005.stderr:+ restore_commit_position 14d56a47625e 2024-09-17T23:05:32.763 INFO:tasks.workunit.client.0.smithi005.stderr:+ local journal=14d56a47625e 2024-09-17T23:05:32.763 INFO:tasks.workunit.client.0.smithi005.stderr:+ rados -p rbd setomapval journal.14d56a47625e client_ 2024-09-17T23:05:32.789 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:32.800 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:32.800 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal inspect --image testrbdjournal537571 --verbose 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ awk ' 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr: /AioFlush/ {a++} # match: "event_type": "AioFlush", 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr: /AioWrite/ {w++} # match: "event_type": "AioWrite", 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr: /SnapCreate/ {s++} # match: "event_type": "SnapCreate", 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr: /OpFinish/ {f++} # match: "event_type": "OpFinish", 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr: /entries inspected/ {t=$1; e=$4} # match: 14 entries inspected, 0 errors 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr: {print} # for diagnostic 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr: END { 2024-09-17T23:05:32.803 INFO:tasks.workunit.client.0.smithi005.stderr: if (a != 2 || w != 10 || s != 1 || f != 1 || t != 14 || e != 0) exit(1) 2024-09-17T23:05:32.804 INFO:tasks.workunit.client.0.smithi005.stderr: } 2024-09-17T23:05:32.804 INFO:tasks.workunit.client.0.smithi005.stderr: ' 2024-09-17T23:05:32.809 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:32.864 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-17T23:05:32.862+0000 7febc4f8c640 -1 JournalMetadata: 0x55753934d760 failed to locate client: INSPECT 2024-09-17T23:05:32.868 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=1 2024-09-17T23:05:32.868 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.868 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioFlush", 2024-09-17T23:05:32.868 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.352330+0000" 2024-09-17T23:05:32.868 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.868 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=2 2024-09-17T23:05:32.868 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.868 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 0, 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.353647+0000" 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=3 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 4096, 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.353711+0000" 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=4 2024-09-17T23:05:32.869 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 8192, 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.353749+0000" 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=5 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 12288, 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.353849+0000" 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=6 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.870 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 16384, 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.353904+0000" 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=7 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 20480, 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.353945+0000" 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=8 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.871 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 24576, 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.353983+0000" 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=9 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 28672, 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.354014+0000" 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.872 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=10 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 32768, 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.354039+0000" 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=11 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioWrite", 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout: "offset": 36864, 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout: "length": 4096, 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.354073+0000" 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.873 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=12 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "AioFlush", 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.354102+0000" 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=13 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "SnapCreate", 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout: "op_tid": 1, 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout: "snap_name": "test", 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout: "snapshot_namespace_type": "user", 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:31.970331+0000" 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:Entry: tag_id=1, commit_tid=14 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout:{ 2024-09-17T23:05:32.874 INFO:tasks.workunit.client.0.smithi005.stdout: "event_type": "OpFinish", 2024-09-17T23:05:32.875 INFO:tasks.workunit.client.0.smithi005.stdout: "op_tid": 1, 2024-09-17T23:05:32.875 INFO:tasks.workunit.client.0.smithi005.stdout: "op_tid": 1, 2024-09-17T23:05:32.875 INFO:tasks.workunit.client.0.smithi005.stdout: "result": 0, 2024-09-17T23:05:32.875 INFO:tasks.workunit.client.0.smithi005.stdout: "timestamp": "2024-09-17T23:05:32.748867+0000" 2024-09-17T23:05:32.875 INFO:tasks.workunit.client.0.smithi005.stdout:} 2024-09-17T23:05:32.875 INFO:tasks.workunit.client.0.smithi005.stdout:Summary: 2024-09-17T23:05:32.875 INFO:tasks.workunit.client.0.smithi005.stdout: 14 entries inspected, 0 errors 2024-09-17T23:05:32.875 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd export testrbdjournal537571@test /tmp/rbd_journal53757/testrbdjournal537571.export 2024-09-17T23:05:32.893 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:32.891+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:32.921 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:32.921 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:32.935 INFO:tasks.workunit.client.0.smithi005.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2024-09-17T23:05:32.941 INFO:tasks.workunit.client.0.smithi005.stderr:+ cmp /tmp/rbd_journal53757/testrbdjournal53757.export /tmp/rbd_journal53757/testrbdjournal537571.export 2024-09-17T23:05:32.942 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:32.942 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:32.954 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:32.952+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:32.956 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:32.956 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:32.959 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:32.959 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:32.966 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:32.977 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:32.977 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:32.995 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:32.995 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:33.012 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:05:33.012 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:05:33.016 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:33.017 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:33.040 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal reset 132cc2a15bff 2024-09-17T23:05:33.054 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:33.052+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:33.109 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd journal inspect --verbose 132cc2a15bff 2024-09-17T23:05:33.109 INFO:tasks.workunit.client.0.smithi005.stderr:+ expect_false grep event_type 2024-09-17T23:05:33.109 INFO:tasks.workunit.client.0.smithi005.stderr:+ set -x 2024-09-17T23:05:33.109 INFO:tasks.workunit.client.0.smithi005.stderr:+ grep event_type 2024-09-17T23:05:33.115 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:33.115 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:33.115 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:33.115 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:33.124 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:33.150 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-17T23:05:33.148+0000 7fbff1d41640 -1 JournalMetadata: 0x55e4aee9b260 failed to locate client: INSPECT 2024-09-17T23:05:33.153 INFO:tasks.workunit.client.0.smithi005.stderr:+ return 0 2024-09-17T23:05:33.153 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd snap purge testrbdjournal537571 2024-09-17T23:05:33.155 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:33.153+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:33.231 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:33.231 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:33.231 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:33.231 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:33.231 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:33.240 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:33.284 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:33.282+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:33.345 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 187.10579028999999, 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.346 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.347 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:33.348 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.349 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.350 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.351 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:33.352 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 186.10428832700001, 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033297520000000001, 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 5 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237948+0000", 2024-09-17T23:05:33.354 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237950+0000", 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.052e-06 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237962+0000", 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.153e-05 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.355 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237981+0000", 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.237994+0000", 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3077e-05 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238077+0000", 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2929000000000005e-05 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.356 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.238083+0000", 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000001e-06 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239652+0000", 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001569204 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239777+0000", 2024-09-17T23:05:33.357 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124991 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.239895+0000", 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00011807300000000001 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.240677+0000", 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078165400000000001 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.358 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241208+0000", 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00053154899999999998 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241247+0000", 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8696999999999999e-05 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:27.241278+0000", 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1325999999999998e-05 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.359 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 185.09841340200001, 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0039549329999999999, 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:33.360 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243823+0000", 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.361 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243825+0000", 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1229999999999998e-06 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243835+0000", 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9860000000000006e-06 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243863+0000", 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7766000000000001e-05 2024-09-17T23:05:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243877+0000", 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3348e-05 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243957+0000", 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0166999999999993e-05 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op must wait for map", 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.243965+0000", 2024-09-17T23:05:33.363 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8140000000000001e-06 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245635+0000", 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001670211 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245713+0000", 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7945e-05 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 1", 2024-09-17T23:05:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.245826+0000", 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112794 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247336+0000", 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0015103250000000001 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247683+0000", 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000346867 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.365 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247732+0000", 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8819999999999997e-05 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:28.247778+0000", 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6767000000000001e-05 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:7 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:33.366 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.377062833, 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001342205, 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 7 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:33.367 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965174+0000", 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965175+0000", 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8000000000000005e-07 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965185+0000", 2024-09-17T23:05:33.368 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8490000000000001e-06 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965194+0000", 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6800000000000005e-06 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965199+0000", 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9649999999999999e-06 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.369 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965242+0000", 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3211999999999999e-05 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965332+0000", 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0064999999999999e-05 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965461+0000", 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000128744 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965973+0000", 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051177700000000004 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966457+0000", 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048425900000000001 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966491+0000", 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599000000000001e-05 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.371 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.966516+0000", 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5275000000000001e-05 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:9 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.375213804, 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088105499999999995, 2024-09-17T23:05:33.372 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 9 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.373 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967023+0000", 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967024+0000", 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0999999999999997e-07 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.374 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967029+0000", 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7419999999999997e-06 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967040+0000", 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1419e-05 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967047+0000", 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5019999999999998e-06 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.375 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967092+0000", 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5580000000000001e-05 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967171+0000", 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9357000000000006e-05 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967824+0000", 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065246499999999997 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.376 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967863+0000", 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9280999999999999e-05 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.967904+0000", 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0799e-05 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.377 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:12 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch watch cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.133536038, 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010903149999999999, 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 12 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.378 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208701+0000", 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.379 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208703+0000", 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.939e-06 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208709+0000", 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2550000000000003e-06 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208713+0000", 2024-09-17T23:05:33.380 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7280000000000001e-06 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208746+0000", 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3149999999999999e-05 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208789+0000", 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2658999999999999e-05 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:33.381 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.208886+0000", 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6646999999999998e-05 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209327+0000", 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044167799999999998 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209719+0000", 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039153700000000002 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.382 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209748+0000", 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9009999999999998e-05 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.209791+0000", 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3185000000000001e-05 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.383 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:14 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.132042099, 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00088913499999999999, 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 14 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.384 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210195+0000", 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1100000000000005e-07 2024-09-17T23:05:33.385 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210201+0000", 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8320000000000002e-06 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210211+0000", 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6180000000000001e-06 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210217+0000", 2024-09-17T23:05:33.386 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9449999999999998e-06 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210252+0000", 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5204999999999999e-05 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210293+0000", 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0769000000000002e-05 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:33.387 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210391+0000", 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8590000000000003e-05 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.210760+0000", 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00036825699999999998 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211035+0000", 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027564899999999999 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.388 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211063+0000", 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7937999999999999e-05 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.211084+0000", 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0520999999999999e-05 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.389 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:20 2.2 2:5b10050d:::journal.132cc2a15bff:head [watch watch cookie 139790783711696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.13011337499999, 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091329400000000004, 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 20 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.390 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212123+0000", 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212124+0000", 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1900000000000002e-07 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.391 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212127+0000", 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3670000000000001e-06 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212134+0000", 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6050000000000003e-06 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.392 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212138+0000", 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0910000000000003e-06 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212183+0000", 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4761000000000001e-05 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212263+0000", 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9923e-05 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.393 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212954+0000", 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069148500000000004 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.212983+0000", 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8923000000000001e-05 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.213037+0000", 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3520000000000003e-05 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.394 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:25 2.3 2:c99a3da3:::journal_data.2.132cc2a15bff.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.12745287600001, 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00094777299999999995, 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:33.395 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 25 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214784+0000", 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.396 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214785+0000", 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214787+0000", 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6280000000000001e-06 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214793+0000", 2024-09-17T23:05:33.397 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2820000000000002e-06 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214797+0000", 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6710000000000001e-06 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214832+0000", 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4629000000000003e-05 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.398 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214913+0000", 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1675000000000007e-05 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215732+0000", 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00081825300000000001 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:33.399 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.142086695, 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.400 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.401 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.402 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.403 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:33.404 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 110.14195988100001, 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.405 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:33.407 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:33.408 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.409 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:45 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 2] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 25.125764534999998, 2024-09-17T23:05:33.410 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091518199999999995, 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 45 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:33.411 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216472+0000", 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216474+0000", 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6950000000000001e-06 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.412 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216490+0000", 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6109000000000001e-05 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216505+0000", 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.449e-05 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216513+0000", 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2290000000000003e-06 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.413 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216592+0000", 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9078000000000004e-05 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.216713+0000", 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000121067 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:08.217387+0000", 2024-09-17T23:05:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00067451399999999997 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5853.0:30 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.set_minimum_set in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.088323+0000", 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.25391326600000003, 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010818329999999999, 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.415 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5853", 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/661142559", 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088323+0000", 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088323+0000", 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.416 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088324+0000", 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9299999999999997e-07 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088328+0000", 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.07e-06 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.417 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088338+0000", 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8460000000000003e-06 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088349+0000", 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1114000000000001e-05 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088388+0000", 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8878000000000003e-05 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.418 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088436+0000", 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7339000000000002e-05 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.089405+0000", 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00096979300000000004 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5853.0:31 2.2 2:5b10050d:::journal.132cc2a15bff:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-17T23:05:33.419 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.088361+0000", 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.25387533299999998, 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0013320039999999999, 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5853", 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/661142559", 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 31 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.420 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088361+0000", 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088361+0000", 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.421 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088362+0000", 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0499999999999999e-07 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088364+0000", 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7850000000000001e-06 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088369+0000", 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6060000000000002e-06 2024-09-17T23:05:33.422 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088372+0000", 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.05e-06 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088642+0000", 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027016799999999999 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.423 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088724+0000", 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1366000000000007e-05 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.089558+0000", 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00083438499999999999 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.089610+0000", 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2289e-05 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.424 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.089693+0000", 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3049999999999999e-05 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5853.0:41 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.create in=13b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.094044+0000", 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.24819286500000001, 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001140063, 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.425 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5853", 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/661142559", 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 41 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.094044+0000", 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.426 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.094044+0000", 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.094045+0000", 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.23e-07 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.094049+0000", 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1320000000000004e-06 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.427 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.094058+0000", 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9390000000000003e-06 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.094062+0000", 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5639999999999998e-06 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.094107+0000", 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4443000000000001e-05 2024-09-17T23:05:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.094179+0000", 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2281999999999997e-05 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095036+0000", 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00085656700000000003 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095095+0000", 2024-09-17T23:05:33.429 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9129000000000003e-05 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095184+0000", 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9283999999999994e-05 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5853.0:43 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.tag_create in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.095906+0000", 2024-09-17T23:05:33.430 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.24633053199999999, 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00096819699999999996, 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5853", 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/661142559", 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 43 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.431 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095906+0000", 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095906+0000", 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.432 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095907+0000", 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4899999999999995e-07 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095910+0000", 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8550000000000002e-06 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095917+0000", 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4699999999999996e-06 2024-09-17T23:05:33.433 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095921+0000", 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1699999999999999e-06 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.095960+0000", 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8528000000000001e-05 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.434 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.096034+0000", 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3844999999999995e-05 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.096736+0000", 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000702183 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.096791+0000", 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5374999999999998e-05 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.435 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.096874+0000", 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3221999999999997e-05 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5853.0:46 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.097818+0000", 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.24441870099999999, 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00099243000000000009, 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.436 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5853", 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/661142559", 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 46 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.097818+0000", 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.437 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.097818+0000", 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.097819+0000", 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9400000000000005e-07 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.097822+0000", 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0180000000000002e-06 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.438 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.097829+0000", 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8970000000000002e-06 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.097832+0000", 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.721e-06 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.097872+0000", 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9845999999999998e-05 2024-09-17T23:05:33.439 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.097945+0000", 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2624000000000001e-05 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.098670+0000", 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00072471099999999995 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.440 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.098726+0000", 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6203999999999999e-05 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.098810+0000", 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4715000000000005e-05 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.441 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5853.0:48 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [call rbd.set_features in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.099595+0000", 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.24264203200000001, 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00089994800000000002, 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5853", 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/661142559", 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 48 2024-09-17T23:05:33.442 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.099595+0000", 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.099595+0000", 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.443 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.099596+0000", 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.71e-07 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.099606+0000", 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.028e-05 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.099617+0000", 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0832999999999999e-05 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.444 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.099622+0000", 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5600000000000001e-06 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.099675+0000", 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2917999999999997e-05 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.099760+0000", 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5056999999999996e-05 2024-09-17T23:05:33.445 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.100403+0000", 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00064259400000000002 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.100436+0000", 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2663999999999998e-05 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.100495+0000", 2024-09-17T23:05:33.446 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9171e-05 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5853.0:53 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch unwatch cookie 139834404377696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.102690+0000", 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.23954633, 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00095583099999999998, 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.447 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5853", 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/661142559", 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 53 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.102690+0000", 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.448 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.102690+0000", 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.102691+0000", 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2e-07 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.102693+0000", 2024-09-17T23:05:33.449 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1270000000000001e-06 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.102700+0000", 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7309999999999996e-06 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.102704+0000", 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0849999999999999e-06 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.450 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.103010+0000", 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00030620700000000002 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.103080+0000", 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0043999999999995e-05 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.103517+0000", 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00043668800000000002 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.451 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.103544+0000", 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7398000000000001e-05 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.103646+0000", 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000102031 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5399.0:1 2.2 2:5b10050d:::journal.132cc2a15bff:head [call journal.client_register in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-17T23:05:33.452 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.141093+0000", 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.20114367499999999, 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010780169999999999, 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5399", 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1751776035", 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.453 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.141093+0000", 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.141093+0000", 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.141095+0000", 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4670000000000001e-06 2024-09-17T23:05:33.454 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.141099+0000", 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8749999999999999e-06 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.141109+0000", 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3919999999999992e-06 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.141117+0000", 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3629999999999994e-06 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.455 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.141175+0000", 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7781999999999997e-05 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.141249+0000", 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3898000000000003e-05 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.142086+0000", 2024-09-17T23:05:33.456 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000837347 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.142120+0000", 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4097000000000002e-05 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.142171+0000", 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0796e-05 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.457 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.458 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.458 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:33.459 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:33.460 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:33.457+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:33.560 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:33.557+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:33.602 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:33.603 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:33.603 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:33.603 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:33.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:33.696 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:33.694+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:33.758 INFO:tasks.workunit.client.0.smithi005.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T23:05:33.762 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:33.760+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:33.762 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:33.762 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:33.762 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:33.762 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:33.762 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:33.765 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdjournal537571 2024-09-17T23:05:33.771 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:33.850 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete...2024-09-17T23:05:33.847+0000 7fea6abe2640 0 -- 172.21.15.5:0/3645110916 >> [v2:172.21.15.152:6818/2095030613,v1:172.21.15.152:6819/2095030613] conn(0x5557ba731290 msgr2=0x5557ba733720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:33.854 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T23:05:33.852+0000 7fea6abe2640 0 -- 172.21.15.5:0/3645110916 >> [v2:172.21.15.152:6818/2095030613,v1:172.21.15.152:6819/2095030613] conn(0x7fea4c071ca0 msgr2=0x7fea4c074090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:33.863 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:33.861+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:33.875 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 100% complete...done. 2024-09-17T23:05:33.878 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdjournal53757 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4908.0:6 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.957494521, 2024-09-17T23:05:33.925 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001240321, 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4908", 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1178871075", 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 6 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.926 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963835+0000", 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963837+0000", 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963864+0000", 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7076999999999998e-05 2024-09-17T23:05:33.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963890+0000", 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6339999999999999e-05 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.963917+0000", 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6665999999999998e-05 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.928 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964041+0000", 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000124442 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964213+0000", 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017174399999999999 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.964993+0000", 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00078003000000000002 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.929 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965027+0000", 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3816999999999998e-05 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:37.965075+0000", 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8294999999999998e-05 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4679.0:2 2.6 2:7f07c04f:::rbd_id.testrbdjournal53757:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e47)", 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:33.930 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.910709962, 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029512599999999998, 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4679", 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/1323640525", 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 2 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:33.931 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010619+0000", 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010620+0000", 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.932 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010623+0000", 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1020000000000001e-06 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010629+0000", 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2960000000000004e-06 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010633+0000", 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8800000000000001e-06 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.933 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010666+0000", 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2231999999999999e-05 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.010707+0000", 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1813000000000001e-05 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.013571+0000", 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028633019999999999 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.934 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:28 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e47)", 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.706468407, 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002291997, 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 28 2024-09-17T23:05:33.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214861+0000", 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.936 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214862+0000", 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214866+0000", 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4689999999999999e-06 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214877+0000", 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0276e-05 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.937 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214884+0000", 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3749999999999997e-06 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.214936+0000", 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.236e-05 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.215013+0000", 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6956e-05 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:38.217153+0000", 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021397059999999999 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5853.0:29 2.7 2:e6129b11:::journal_data.2.132cc2a15bff.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e102)", 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.087048+0000", 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.83428158299999999, 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011770490000000001, 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.939 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5853", 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/661142559", 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087048+0000", 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.940 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087048+0000", 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087048+0000", 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1500000000000004e-07 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087053+0000", 2024-09-17T23:05:33.941 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.031e-06 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087064+0000", 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1742e-05 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087070+0000", 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.412e-06 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.942 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087113+0000", 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3529999999999998e-05 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087162+0000", 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8316999999999998e-05 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 4", 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087220+0000", 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8597999999999997e-05 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087798+0000", 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00057810800000000003 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088135+0000", 2024-09-17T23:05:33.944 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00033659500000000003 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088167+0000", 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1946999999999998e-05 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088225+0000", 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8053999999999997e-05 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.945 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5868.0:15 2.7 2:fdb1f2e8:::rbd_header.14d56a47625e:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.194286+0000", 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.727043573, 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011915750000000001, 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5868", 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 15 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.946 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194286+0000", 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194286+0000", 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194286+0000", 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0999999999999998e-07 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194290+0000", 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5219999999999999e-06 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194297+0000", 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9120000000000001e-06 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194301+0000", 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1110000000000001e-06 2024-09-17T23:05:33.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194343+0000", 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1980000000000001e-05 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194422+0000", 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9269000000000003e-05 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 4", 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.194589+0000", 2024-09-17T23:05:33.949 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016678600000000001 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.195080+0000", 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00049111300000000005 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.195336+0000", 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000256049 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.195389+0000", 2024-09-17T23:05:33.950 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2571000000000002e-05 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.195477+0000", 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8652000000000004e-05 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5868.0:52 2.7 2:fdb1f2e8:::rbd_header.14d56a47625e:head [call rbd.snapshot_trash_add in=21b] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.213601+0000", 2024-09-17T23:05:33.951 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.70772866300000004, 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001206412, 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5868", 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 52 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.952 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213601+0000", 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213601+0000", 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213601+0000", 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6700000000000003e-07 2024-09-17T23:05:33.953 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213604+0000", 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.841e-06 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213612+0000", 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5009999999999998e-06 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213618+0000", 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9549999999999997e-06 2024-09-17T23:05:33.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213649+0000", 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1106999999999999e-05 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213697+0000", 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8548999999999999e-05 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 4", 2024-09-17T23:05:33.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.213902+0000", 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000204959 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.214439+0000", 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000537266 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.214727+0000", 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028714499999999999 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.214761+0000", 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4351999999999999e-05 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.214807+0000", 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.617e-05 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.957 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5868.0:55 2.7 2:fdb1f2e8:::rbd_header.14d56a47625e:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.748572+0000", 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.17275748299999999, 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0014092899999999999, 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5868", 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 55 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748572+0000", 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748572+0000", 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748573+0000", 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.531e-06 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748583+0000", 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2010000000000005e-06 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748595+0000", 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.221e-05 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748605+0000", 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0271999999999999e-05 2024-09-17T23:05:33.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748651+0000", 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5534000000000001e-05 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748729+0000", 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7881999999999997e-05 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 4", 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.748972+0000", 2024-09-17T23:05:33.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000243837 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.749682+0000", 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00070948500000000004 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.749899+0000", 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00021724 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.749933+0000", 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3843000000000001e-05 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.749981+0000", 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8254999999999998e-05 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5868.0:67 2.7 2:fdb1f2e8:::rbd_header.14d56a47625e:head [watch unwatch cookie 139730654157584] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.759081+0000", 2024-09-17T23:05:33.963 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.16224868000000001, 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00122175, 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5868", 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 67 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759081+0000", 2024-09-17T23:05:33.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759081+0000", 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759081+0000", 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3599999999999999e-07 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759083+0000", 2024-09-17T23:05:33.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6840000000000001e-06 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759087+0000", 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4109999999999998e-06 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759090+0000", 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9450000000000002e-06 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759284+0000", 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000194305 2024-09-17T23:05:33.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759364+0000", 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9349000000000002e-05 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 4", 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759510+0000", 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000146491 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759932+0000", 2024-09-17T23:05:33.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000421576 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.760195+0000", 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00026321199999999997 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.760226+0000", 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1031999999999997e-05 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.760302+0000", 2024-09-17T23:05:33.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6409000000000007e-05 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5868.0:68 2.7 2:fdb1f2e8:::rbd_header.14d56a47625e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.759277+0000", 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.162052367, 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0011584080000000001, 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.969 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5868", 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 68 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759277+0000", 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759277+0000", 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759278+0000", 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6499999999999999e-07 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759281+0000", 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9239999999999999e-06 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.971 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759286+0000", 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2379999999999997e-06 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759289+0000", 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5719999999999999e-06 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759730+0000", 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044069500000000001 2024-09-17T23:05:33.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for rw locks", 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.759814+0000", 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3527000000000002e-05 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.760331+0000", 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051769399999999997 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.760368+0000", 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6976e-05 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.760435+0000", 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7117000000000001e-05 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:13 2.7 2:fdb1f2e8:::rbd_header.14d56a47625e:head [watch watch cookie 140644139942624] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:33.974 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.807630+0000", 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.113699033, 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0013726929999999999, 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 13 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807630+0000", 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807630+0000", 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807631+0000", 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1999999999999999e-07 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.976 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807634+0000", 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7970000000000001e-06 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807640+0000", 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7499999999999997e-06 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807644+0000", 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8940000000000003e-06 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807689+0000", 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4375000000000001e-05 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807769+0000", 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0672000000000003e-05 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 4", 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.807941+0000", 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017167699999999999 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.808547+0000", 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060637400000000002 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.808824+0000", 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027626099999999998 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.808885+0000", 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1039999999999998e-05 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.809003+0000", 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000118233 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:23 2.7 2:fdb1f2e8:::rbd_header.14d56a47625e:head [watch unwatch cookie 140644139942624] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.813536+0000", 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.107793721, 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001285333, 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.980 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 23 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813536+0000", 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813536+0000", 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813536+0000", 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1799999999999995e-07 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813539+0000", 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5110000000000002e-06 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813547+0000", 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3019999999999995e-06 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813556+0000", 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.1770000000000004e-06 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813748+0000", 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019170600000000001 2024-09-17T23:05:33.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813828+0000", 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0524000000000004e-05 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 4", 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813992+0000", 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016364999999999999 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:33.984 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.814415+0000", 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00042243499999999998 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.814706+0000", 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00029170699999999999 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.814739+0000", 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.2363999999999997e-05 2024-09-17T23:05:33.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.814821+0000", 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2338999999999999e-05 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:24 2.7 2:fdb1f2e8:::rbd_header.14d56a47625e:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.813868+0000", 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.107461503, 2024-09-17T23:05:33.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012018370000000001, 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 24 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813868+0000", 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813868+0000", 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813868+0000", 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3499999999999996e-07 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813872+0000", 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.726e-06 2024-09-17T23:05:33.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813881+0000", 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4239999999999993e-06 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.813887+0000", 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3949999999999998e-06 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.814208+0000", 2024-09-17T23:05:33.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00032108800000000003 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for rw locks", 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.814289+0000", 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1328999999999993e-05 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.814866+0000", 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00057625299999999999 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.814938+0000", 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2705000000000003e-05 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.815070+0000", 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013128200000000001 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:75 2.7 2:fdbbf2eb:::rbd_data.14d56a47625e.0000000000000004:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.846510+0000", 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.074819184999999996, 2024-09-17T23:05:33.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001279182, 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 75 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.846510+0000", 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.846510+0000", 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.846511+0000", 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5599999999999995e-07 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.846513+0000", 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5550000000000001e-06 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.846519+0000", 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9900000000000002e-06 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.846523+0000", 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.298e-06 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.846552+0000", 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9150999999999999e-05 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.846661+0000", 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00010946 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847789+0000", 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001128172 2024-09-17T23:05:33.995 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:81 2.6 2:79e72b5d:::rbd_data.14d56a47625e.000000000000000a:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.847494+0000", 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.073835649000000003, 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001576133, 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:33.996 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 81 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847494+0000", 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847494+0000", 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847495+0000", 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.15e-06 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847499+0000", 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1840000000000001e-06 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:33.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847510+0000", 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0875e-05 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847517+0000", 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5109999999999997e-06 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847574+0000", 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7015999999999998e-05 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:33.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847706+0000", 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000131252 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849070+0000", 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001364145 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.000 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:83 2.7 2:fc874e5c:::rbd_data.14d56a47625e.000000000000000c:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.847921+0000", 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.073408117999999994, 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0019521110000000001, 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 83 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847921+0000", 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847921+0000", 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847922+0000", 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3399999999999998e-07 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847926+0000", 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1559999999999997e-06 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847944+0000", 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7405e-05 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.847951+0000", 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8730000000000001e-06 2024-09-17T23:05:34.003 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848036+0000", 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5340999999999995e-05 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848165+0000", 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012959000000000001 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849873+0000", 2024-09-17T23:05:34.004 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001707912 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:86 2.7 2:fca758b8:::rbd_data.14d56a47625e.000000000000000f:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.848752+0000", 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.072577626000000006, 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001677443, 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:34.005 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 86 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848752+0000", 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848752+0000", 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.006 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848753+0000", 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6899999999999996e-07 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848757+0000", 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4789999999999998e-06 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848771+0000", 2024-09-17T23:05:34.007 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3866000000000001e-05 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848778+0000", 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1280000000000002e-06 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848828+0000", 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9780000000000001e-05 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849004+0000", 2024-09-17T23:05:34.008 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00017581300000000001 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850429+0000", 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001425408 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:87 2.7 2:fbbba110:::rbd_data.14d56a47625e.0000000000000010:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.848845+0000", 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.072484255999999997, 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001937404, 2024-09-17T23:05:34.009 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 87 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848845+0000", 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.010 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848845+0000", 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848846+0000", 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2799999999999995e-07 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848856+0000", 2024-09-17T23:05:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9830000000000008e-06 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848867+0000", 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1396000000000001e-05 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.848874+0000", 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8040000000000004e-06 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.012 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849274+0000", 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00039968300000000002 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849355+0000", 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1248000000000005e-05 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850783+0000", 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001427462 2024-09-17T23:05:34.013 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:89 2.7 2:f18b0147:::rbd_data.14d56a47625e.0000000000000012:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.849777+0000", 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.071552616999999999, 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0035096279999999999, 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:34.014 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 89 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849777+0000", 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849777+0000", 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.015 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849778+0000", 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9999999999999995e-07 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849783+0000", 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9980000000000003e-06 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849795+0000", 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2123000000000001e-05 2024-09-17T23:05:34.016 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849803+0000", 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8129999999999996e-06 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849941+0000", 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013792500000000001 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.017 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850056+0000", 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000114913 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853286+0000", 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0032308559999999998 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:92 2.6 2:77e57faa:::rbd_data.14d56a47625e.0000000000000015:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.850019+0000", 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.071310098000000002, 2024-09-17T23:05:34.018 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0025603520000000001, 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 92 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850019+0000", 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.019 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850019+0000", 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850020+0000", 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6300000000000004e-07 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850024+0000", 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1860000000000002e-06 2024-09-17T23:05:34.020 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850032+0000", 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6729999999999992e-06 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850039+0000", 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9110000000000004e-06 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850084+0000", 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5123999999999997e-05 2024-09-17T23:05:34.021 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850197+0000", 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000112732 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852580+0000", 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0023829630000000001 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.022 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:102 2.7 2:f361c684:::rbd_data.14d56a47625e.000000000000001f:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.852563+0000", 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.068766121999999999, 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0030426569999999998, 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 102 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.023 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852563+0000", 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852563+0000", 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852564+0000", 2024-09-17T23:05:34.024 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.1500000000000003e-07 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852569+0000", 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7910000000000004e-06 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852580+0000", 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1411e-05 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.025 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852596+0000", 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5908000000000001e-05 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852646+0000", 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9882000000000001e-05 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852738+0000", 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.1776999999999999e-05 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.026 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.855606+0000", 2024-09-17T23:05:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028679729999999998 2024-09-17T23:05:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.027 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.027 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:34.029 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:05:34.030 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:34.026+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:34.031 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete...2024-09-17T23:05:33.961+0000 7f7a6a7f5640 0 -- 172.21.15.5:0/2988876083 >> [v2:172.21.15.5:6808/1475101831,v1:172.21.15.5:6809/1475101831] conn(0x7f7a4806b9d0 msgr2=0x7f7a4806c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:34.129 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:34.127+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:34.164 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2024-09-17T23:05:34.162+0000 7f7a6a7f5640 0 -- 172.21.15.5:0/2988876083 >> [v2:172.21.15.5:6808/1475101831,v1:172.21.15.5:6809/1475101831] conn(0x7f7a4806b9d0 msgr2=0x7f7a4806c6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:34.173 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:34.173 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:34.173 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:34.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:05:34.266 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:34.264+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:34.326 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:34.326 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:34.326 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:34.326 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:34.326 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:34.330 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:34.328+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:34.335 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:05:34.431 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:34.429+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5853.0:27 2.0 e102/100 2:1ca8da49:::journal_data.2.132cc2a15bff.1:head v 102'21, mlcod=102'19)", 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.087330+0000", 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.389769112, 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00069604599999999997, 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.480 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087330+0000", 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087330+0000", 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.481 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087331+0000", 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.217e-06 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087342+0000", 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.117e-05 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.482 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087361+0000", 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.893e-05 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087370+0000", 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0820000000000005e-06 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087442+0000", 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1737999999999997e-05 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.483 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087466+0000", 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4301e-05 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.087978+0000", 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00051139700000000002 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.088026+0000", 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8211000000000003e-05 2024-09-17T23:05:34.484 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5868.0:16 2.0 e102/100 2:167788c7:::journal.14d56a47625e:head v 102'22, mlcod=102'20)", 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.196678+0000", 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.2804209010000001, 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00055445799999999997, 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.485 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.196678+0000", 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.196678+0000", 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.486 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.196679+0000", 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9199999999999999e-07 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.196687+0000", 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7030000000000006e-06 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.196702+0000", 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5279000000000001e-05 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.487 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.196715+0000", 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3047999999999999e-05 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.196770+0000", 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5473000000000002e-05 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.196791+0000", 2024-09-17T23:05:34.488 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0123e-05 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.197197+0000", 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00040679900000000001 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.197232+0000", 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5141000000000001e-05 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.489 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5868.0:37 2.0 e102/100 2:167788c7:::journal.14d56a47625e:head v 102'23, mlcod=102'21)", 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.207462+0000", 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.2696372149999999, 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00057876100000000001, 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.207462+0000", 2024-09-17T23:05:34.490 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.207462+0000", 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.207463+0000", 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.091e-06 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.491 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.207471+0000", 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9170000000000006e-06 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.207482+0000", 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1009000000000001e-05 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.207487+0000", 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7809999999999996e-06 2024-09-17T23:05:34.492 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.207551+0000", 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4772999999999998e-05 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.207568+0000", 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6500000000000001e-05 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.208009+0000", 2024-09-17T23:05:34.493 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044079200000000002 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.208040+0000", 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1897999999999999e-05 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5868.0:43 2.0 e102/100 2:167788c7:::journal.14d56a47625e:head v 102'24, mlcod=102'22)", 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.210817+0000", 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.2662823839999999, 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00050436299999999997, 2024-09-17T23:05:34.494 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.210817+0000", 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.210817+0000", 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.495 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.210817+0000", 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6199999999999997e-07 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.210822+0000", 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5430000000000004e-06 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.210831+0000", 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0680000000000003e-06 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.496 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.210835+0000", 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4669999999999998e-06 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.210899+0000", 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3472999999999994e-05 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.210913+0000", 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4387e-05 2024-09-17T23:05:34.497 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.211289+0000", 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00037593300000000001 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.211321+0000", 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1829999999999998e-05 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.498 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5868.0:57 2.0 e103/100 2:167788c7:::journal.14d56a47625e:head v 103'25, mlcod=102'23)", 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.753877+0000", 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.72322181699999999, 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00060968100000000005, 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.753877+0000", 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.499 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.753877+0000", 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.753877+0000", 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4999999999999999e-07 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.753882+0000", 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.096e-06 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.753900+0000", 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7833999999999999e-05 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.753908+0000", 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8909999999999995e-06 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.753970+0000", 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1552999999999998e-05 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.753994+0000", 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4589000000000001e-05 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.754440+0000", 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00044560900000000002 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.754487+0000", 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6859e-05 2024-09-17T23:05:34.502 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5868.0:64 2.0 e103/100 2:167788c7:::journal.14d56a47625e:head v 103'26, mlcod=102'24)", 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.757240+0000", 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.71985924700000004, 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00046412299999999999, 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757240+0000", 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757240+0000", 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757240+0000", 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1699999999999997e-07 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757248+0000", 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3839999999999999e-06 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757258+0000", 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9550000000000004e-06 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757262+0000", 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5600000000000004e-06 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757298+0000", 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5923999999999997e-05 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757313+0000", 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4876e-05 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757679+0000", 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000366113 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.757704+0000", 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4593999999999999e-05 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 54 entries 103'27 (0'0) error 2:1c4e7e2c:::rbd_data.14d56a47625e.000000000000001e:head by client.5411.0:101 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'25)", 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.852754+0000", 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.62434501899999995, 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00059251300000000002, 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852754+0000", 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852754+0000", 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852755+0000", 2024-09-17T23:05:34.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.136e-06 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852769+0000", 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4239e-05 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852796+0000", 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6636999999999999e-05 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852814+0000", 2024-09-17T23:05:34.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8124000000000001e-05 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852915+0000", 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00010127400000000001 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853346+0000", 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00043110300000000001 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5411.0:111 2.0 e103/100 2:167788c7:::journal.14d56a47625e:head v 103'28, mlcod=103'26)", 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.861350+0000", 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.61574886399999995, 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00047893099999999999, 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861350+0000", 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861350+0000", 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861351+0000", 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0900000000000001e-07 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861356+0000", 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5589999999999996e-06 2024-09-17T23:05:34.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861368+0000", 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1800999999999999e-05 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861378+0000", 2024-09-17T23:05:34.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0370000000000001e-05 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861423+0000", 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4589999999999998e-05 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861440+0000", 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6796e-05 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861794+0000", 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00035436799999999998 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.861829+0000", 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4737999999999998e-05 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5411.0:115 2.0 e103/100 2:167788c7:::journal.14d56a47625e:head v 103'29, mlcod=103'27)", 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.863369+0000", 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.61372971399999998, 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00045072999999999999, 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863369+0000", 2024-09-17T23:05:34.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863369+0000", 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863370+0000", 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8100000000000002e-07 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863375+0000", 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8679999999999998e-06 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863385+0000", 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8509999999999994e-06 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863390+0000", 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.835e-06 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863428+0000", 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7629999999999997e-05 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863443+0000", 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4534e-05 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863792+0000", 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00034962099999999999 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.519 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.863820+0000", 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7710000000000001e-05 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 58 entries 103'30 (0'0) error 2:167788c7:::journal.14d56a47625e:head by client.5411.0:120 0.000000 -22 [r=-22+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'28)", 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.865467+0000", 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.611632026, 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001151111, 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.520 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865467+0000", 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865467+0000", 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865468+0000", 2024-09-17T23:05:34.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0699999999999997e-07 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865476+0000", 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1829999999999994e-06 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865491+0000", 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5568000000000001e-05 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865500+0000", 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6969999999999999e-06 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865557+0000", 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6836000000000003e-05 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.866618+0000", 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0010612200000000001 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5411.0:121 2.0 e103/100 2:167788c7:::journal.14d56a47625e:head v 103'31, mlcod=103'28)", 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.865702+0000", 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.61139647100000005, 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0037829550000000002, 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865702+0000", 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865702+0000", 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865703+0000", 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4000000000000002e-07 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865708+0000", 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5120000000000002e-06 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865718+0000", 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0000000000000001e-05 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865721+0000", 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6559999999999998e-06 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865762+0000", 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0995000000000003e-05 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865783+0000", 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0835999999999998e-05 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.869455+0000", 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0036722109999999999 2024-09-17T23:05:34.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.869485+0000", 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0205e-05 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 63 entries 103'32 (0'0) error 2:04595e25:::rbd_data.132cc2a15bff.0000000000000001:head by client.5883.0:72 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'30)", 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.961541+0000", 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.51555809100000005, 2024-09-17T23:05:34.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00065281699999999998, 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.961541+0000", 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.961541+0000", 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.961542+0000", 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1519999999999999e-06 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.961555+0000", 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2918000000000001e-05 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.961586+0000", 2024-09-17T23:05:34.530 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1563000000000003e-05 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.961615+0000", 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8728999999999999e-05 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.961714+0000", 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8375000000000006e-05 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962194+0000", 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00048008000000000002 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 67 entries 103'33 (0'0) error 2:068c927a:::rbd_data.132cc2a15bff.000000000000000c:head by client.5883.0:83 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'30)", 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.962670+0000", 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.51442892799999995, 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002474675, 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.532 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962670+0000", 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962670+0000", 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962671+0000", 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6499999999999999e-07 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962677+0000", 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6329999999999999e-06 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962692+0000", 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5242000000000001e-05 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962702+0000", 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.1379999999999996e-06 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962761+0000", 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9585e-05 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965145+0000", 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002383512 2024-09-17T23:05:34.535 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 71 entries 103'34 (0'0) error 2:040098b5:::rbd_data.132cc2a15bff.0000000000000019:head by client.5883.0:96 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'32)", 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.965877+0000", 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.51122169100000003, 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0022731159999999999, 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:34.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965877+0000", 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965877+0000", 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965878+0000", 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6699999999999999e-07 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965888+0000", 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0103e-05 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965902+0000", 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4351e-05 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965911+0000", 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3370000000000006e-06 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965984+0000", 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2508000000000004e-05 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968150+0000", 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00216635 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:34.539 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:34.541 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:34.538+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:34.541 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:34.595 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 100% complete...done. 2024-09-17T23:05:34.599 INFO:tasks.workunit.client.0.smithi005.stderr:+ set +x 2024-09-17T23:05:34.599 INFO:tasks.workunit.client.0.smithi005.stderr:+ test_rbd_create 2024-09-17T23:05:34.599 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdcreate53757 2024-09-17T23:05:34.599 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd create --image-feature exclusive-lock --image-feature journaling --journal-pool rbd --journal-object-size 20M --journal-splay-width 6 --size 256 testrbdcreate53757 2024-09-17T23:05:34.641 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:34.639+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:34.659 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:34.660 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:34.660 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:34.660 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:34.664 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdcreate53757 'journal info' //journal/order 25 2024-09-17T23:05:34.664 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdcreate53757 2024-09-17T23:05:34.664 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:34.664 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/order 2024-09-17T23:05:34.664 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=25 2024-09-17T23:05:34.665 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdcreate53757 2024-09-17T23:05:34.665 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/order 2024-09-17T23:05:34.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:34.721 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=25 2024-09-17T23:05:34.721 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 25 = 25 2024-09-17T23:05:34.721 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdcreate53757 'journal info' //journal/splay_width 6 2024-09-17T23:05:34.721 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdcreate53757 2024-09-17T23:05:34.721 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:34.721 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/splay_width 2024-09-17T23:05:34.721 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=6 2024-09-17T23:05:34.722 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdcreate53757 2024-09-17T23:05:34.722 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/splay_width 2024-09-17T23:05:34.742 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:34.740+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:34.755 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-17T23:05:34.783 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=6 2024-09-17T23:05:34.783 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 6 = 6 2024-09-17T23:05:34.783 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdcreate53757 'journal info' //journal/object_pool rbd 2024-09-17T23:05:34.783 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdcreate53757 2024-09-17T23:05:34.783 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:34.784 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/object_pool 2024-09-17T23:05:34.784 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=rbd 2024-09-17T23:05:34.784 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdcreate53757 2024-09-17T23:05:34.784 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/object_pool 2024-09-17T23:05:34.786 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:34.786 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:34.786 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:34.786 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:34.786 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:34.796 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:34.843 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=rbd 2024-09-17T23:05:34.843 INFO:tasks.workunit.client.0.smithi005.stderr:+ test rbd = rbd 2024-09-17T23:05:34.844 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdcreate53757 2024-09-17T23:05:34.844 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:34.841+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:34.934 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete...2024-09-17T23:05:34.932+0000 7ff96bfff640 0 -- 172.21.15.5:0/3360718145 >> [v2:172.21.15.5:6800/3261733059,v1:172.21.15.5:6801/3261733059] conn(0x56173c676260 msgr2=0x56173c68f150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:34.940 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... 2024-09-17T23:05:34.938+0000 7ff96bfff640 0 -- 172.21.15.5:0/3360718145 >> [v2:172.21.15.152:6802/3030792595,v1:172.21.15.152:6803/3030792595] conn(0x7ff94c016870 msgr2=0x7ff94c013090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:34.943 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:34.940+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4941.0:26 2.0 2.925b1538 (undecoded) ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e88)", 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 26.742225482999999, 2024-09-17T23:05:34.962 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 21.517741609000002, 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4941", 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:34.963 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216374+0000", 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3590000000000002e-06 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.964 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216385+0000", 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.145e-05 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216405+0000", 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9568999999999998e-05 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216413+0000", 2024-09-17T23:05:34.965 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5990000000000002e-06 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.729688+0000", 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 20.513274776999999 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "waiting for peered", 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.729701+0000", 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.314e-05 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.966 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:29.734099+0000", 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.004397497 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:29.734113+0000", 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4218e-05 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.967 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:57 2.0 2:167788c7:::journal.14d56a47625e:head [call journal.client_commit in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.753334+0000", 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 1.2052624220000001, 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001453441, 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 57 2024-09-17T23:05:34.968 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753334+0000", 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753334+0000", 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.969 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753336+0000", 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0660000000000002e-06 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753344+0000", 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8420000000000005e-06 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753359+0000", 2024-09-17T23:05:34.970 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4969e-05 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753370+0000", 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1005000000000001e-05 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753422+0000", 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2159e-05 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:34.971 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753493+0000", 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.0487999999999993e-05 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "waiting for subops from 7", 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.753648+0000", 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015566399999999999 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.754147+0000", 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00049879899999999997 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.972 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.754629+0000", 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00048179100000000002 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.754693+0000", 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3888999999999998e-05 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:34.973 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.754788+0000", 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4769e-05 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5411.0:120 2.0 2:167788c7:::journal.14d56a47625e:head [call journal.set_minimum_set in=22b] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.865142+0000", 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 1.0934551459999999, 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0016562129999999999, 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:34.974 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5411", 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 120 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865142+0000", 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:34.975 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865142+0000", 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865142+0000", 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9299999999999997e-07 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865146+0000", 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1760000000000003e-06 2024-09-17T23:05:34.976 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865156+0000", 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4420000000000004e-06 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865160+0000", 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6240000000000001e-06 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.977 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865208+0000", 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7246000000000001e-05 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865260+0000", 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2352999999999998e-05 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.866798+0000", 2024-09-17T23:05:34.978 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0015376789999999999 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5411.0:121 2.0 2:167788c7:::journal.14d56a47625e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.865171+0000", 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 1.0934259710000001, 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0046037530000000004, 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:34.979 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5411", 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 121 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865171+0000", 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.980 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865171+0000", 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865171+0000", 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.5699999999999998e-07 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:34.981 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865173+0000", 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.2589999999999999e-06 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865177+0000", 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.8469999999999998e-06 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865180+0000", 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9799999999999998e-06 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.982 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865489+0000", 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00030918900000000002 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865541+0000", 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1588999999999997e-05 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.983 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "waiting for subops from 7", 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865605+0000", 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.4375000000000006e-05 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.866018+0000", 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00041303299999999999 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.869671+0000", 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.003653023 2024-09-17T23:05:34.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.869704+0000", 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2608999999999999e-05 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.869774+0000", 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.0492000000000002e-05 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:34.985 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:72 2.0 2:04595e25:::rbd_data.132cc2a15bff.0000000000000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.961056+0000", 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.99754116100000001, 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0017619529999999999, 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 72 2024-09-17T23:05:34.986 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.961056+0000", 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.961056+0000", 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:34.987 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.961056+0000", 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7700000000000005e-07 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.961059+0000", 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.982e-06 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.961066+0000", 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.4909999999999999e-06 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.988 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.961072+0000", 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7869999999999998e-06 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.961129+0000", 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6341000000000001e-05 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.961250+0000", 2024-09-17T23:05:34.989 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00012186800000000001 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962818+0000", 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001567007 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:83 2.0 2:068c927a:::rbd_data.132cc2a15bff.000000000000000c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.990 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.962106+0000", 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.99649100499999999, 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0034350140000000001, 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 83 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.991 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962106+0000", 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962106+0000", 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962107+0000", 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.64e-07 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.992 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962111+0000", 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.746e-06 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962124+0000", 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2413e-05 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962131+0000", 2024-09-17T23:05:34.993 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.5870000000000004e-06 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962201+0000", 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9307000000000006e-05 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962435+0000", 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00023452100000000001 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:34.994 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965541+0000", 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0031054759999999998 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:96 2.0 2:040098b5:::rbd_data.132cc2a15bff.0000000000000019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.965497+0000", 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.99309925799999998, 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.002835405, 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:34.995 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 96 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965497+0000", 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:34.996 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965497+0000", 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965499+0000", 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.054e-06 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965505+0000", 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7689999999999999e-06 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.997 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965525+0000", 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9278000000000001e-05 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965528+0000", 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.1549999999999999e-06 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965573+0000", 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5232000000000003e-05 2024-09-17T23:05:34.998 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965672+0000", 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.9135999999999994e-05 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.968333+0000", 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0026607810000000001 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:34.999 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:117 2.0 2:1ca8da49:::journal_data.2.132cc2a15bff.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e103)", 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.581259+0000", 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.37733770700000002, 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0027850129999999998, 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 117 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.000 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581259+0000", 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581259+0000", 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.001 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581262+0000", 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0910000000000001e-06 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581274+0000", 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2e-05 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581297+0000", 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.2802e-05 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.002 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581306+0000", 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3179999999999996e-06 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581392+0000", 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6131999999999995e-05 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581493+0000", 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000100577 2024-09-17T23:05:35.003 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.584044+0000", 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0025510929999999999 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:85 2.0 2:05735b28:::rbd_data.152ffc5dba83.000000000000000e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.932896+0000", 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.025700860999999998, 2024-09-17T23:05:35.004 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0031417089999999999, 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 85 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932896+0000", 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.005 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932896+0000", 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932897+0000", 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.8299999999999995e-07 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932901+0000", 2024-09-17T23:05:35.006 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2699999999999998e-06 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932911+0000", 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0190999999999999e-05 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932918+0000", 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6150000000000002e-06 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.007 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932981+0000", 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3139000000000007e-05 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.933100+0000", 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000119298 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936038+0000", 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.002937313 2024-09-17T23:05:35.008 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:85 2.0 2:05735b28:::rbd_data.152ffc5dba83.000000000000000e:head [delete] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.934242+0000", 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.024354595999999999, 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0016851150000000001, 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "waiting for ondisk", 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.009 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 85 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934242+0000", 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934242+0000", 2024-09-17T23:05:35.010 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934243+0000", 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.06e-07 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934245+0000", 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5739999999999998e-06 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.011 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934252+0000", 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.5230000000000001e-06 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934255+0000", 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.1949999999999999e-06 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934342+0000", 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6941000000000007e-05 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.012 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "waiting for ondisk", 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934425+0000", 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2655000000000001e-05 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.935927+0000", 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001502721 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.013 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:88 2.0 2:0ac9897f:::rbd_data.152ffc5dba83.0000000000000010:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.934339+0000", 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.024257276000000001, 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0042441800000000002, 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 88 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.014 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934339+0000", 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934339+0000", 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.015 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934340+0000", 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4900000000000001e-07 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934343+0000", 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8600000000000001e-06 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934351+0000", 2024-09-17T23:05:35.016 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8299999999999996e-06 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934357+0000", 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1279999999999996e-06 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934460+0000", 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010366600000000001 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.017 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934611+0000", 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015087999999999999 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938584+0000", 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0039723670000000001 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.018 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.020 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.020 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.020 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:97 2.0 2:17cb5e50:::rbd_data.152ffc5dba83.0000000000000019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.936843+0000", 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.021753397000000001, 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0020460719999999999, 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 97 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.021 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936843+0000", 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936843+0000", 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936844+0000", 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.8199999999999998e-07 2024-09-17T23:05:35.022 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936850+0000", 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.891e-06 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936863+0000", 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2636999999999999e-05 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936871+0000", 2024-09-17T23:05:35.023 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9689999999999994e-06 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936934+0000", 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3398999999999994e-05 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.937065+0000", 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000130507 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.024 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938889+0000", 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001824787 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:103 2.0 2:1435de61:::rbd_data.152ffc5dba83.000000000000001f:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.938762+0000", 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.019834336000000001, 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.002376857, 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.025 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 103 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938762+0000", 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.026 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938762+0000", 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938763+0000", 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.540000000000001e-07 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938767+0000", 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1330000000000001e-06 2024-09-17T23:05:35.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938777+0000", 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.5179999999999993e-06 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938785+0000", 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.6569999999999997e-06 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938926+0000", 2024-09-17T23:05:35.028 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014157199999999999 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.939038+0000", 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000112212 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941139+0000", 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0021008110000000002 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.029 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:110 2.0 2:10b4ad11:::rbd_data.152ffc5dba83.0000000000000026:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.940075+0000", 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.018521444000000001, 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0038269020000000001, 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 110 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.030 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940075+0000", 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940075+0000", 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940076+0000", 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:35.031 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940080+0000", 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6090000000000001e-06 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940089+0000", 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.9050000000000003e-06 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940094+0000", 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1590000000000001e-06 2024-09-17T23:05:35.032 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940137+0000", 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3575999999999997e-05 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940208+0000", 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.0593000000000007e-05 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.033 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.943902+0000", 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0036942049999999999 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:111 2.0 2:066f7604:::rbd_data.152ffc5dba83.0000000000000027:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.940106+0000", 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.018490697, 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0039373209999999997, 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.034 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 111 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940106+0000", 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940106+0000", 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.035 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940106+0000", 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2500000000000001e-07 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940117+0000", 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0282000000000001e-05 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.036 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940125+0000", 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9629999999999998e-06 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940133+0000", 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4500000000000004e-06 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940404+0000", 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00027054299999999999 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.037 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940486+0000", 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2095999999999995e-05 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944043+0000", 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0035575619999999998 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.038 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:112 2.0 2:07e0d52b:::rbd_data.152ffc5dba83.0000000000000028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.940143+0000", 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.018454042, 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0064686070000000003, 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 112 2024-09-17T23:05:35.039 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940143+0000", 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940143+0000", 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.040 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940143+0000", 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.1299999999999999e-07 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940146+0000", 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.2790000000000001e-06 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940153+0000", 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7789999999999998e-06 2024-09-17T23:05:35.041 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940157+0000", 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.729e-06 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940688+0000", 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00053037199999999998 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940821+0000", 2024-09-17T23:05:35.042 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000133805 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946611+0000", 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0057898300000000002 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:114 2.0 2:1f546182:::rbd_data.152ffc5dba83.000000000000002a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.941241+0000", 2024-09-17T23:05:35.043 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.017355299000000001, 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0055991820000000003, 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 114 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.044 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941241+0000", 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941241+0000", 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941242+0000", 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.7899999999999997e-07 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.045 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941248+0000", 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4319999999999998e-06 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941256+0000", 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4470000000000006e-06 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941261+0000", 2024-09-17T23:05:35.046 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0420000000000002e-06 2024-09-17T23:05:35.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.047 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941308+0000", 2024-09-17T23:05:35.047 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7070999999999997e-05 2024-09-17T23:05:35.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.047 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.047 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941380+0000", 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.1926000000000002e-05 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946841+0000", 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0054604850000000002 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.048 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:117 2.0 2:15e34b47:::rbd_data.152ffc5dba83.000000000000002d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.942633+0000", 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.015964189, 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0043451030000000003, 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 117 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.049 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942633+0000", 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942633+0000", 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942633+0000", 2024-09-17T23:05:35.050 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.0200000000000001e-07 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942637+0000", 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9570000000000004e-06 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942647+0000", 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.312e-06 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.051 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942651+0000", 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3780000000000003e-06 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942700+0000", 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8730999999999998e-05 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942833+0000", 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000133118 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.052 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946978+0000", 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0041448049999999997 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:121 2.0 2:050a4296:::rbd_data.152ffc5dba83.0000000000000031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.944218+0000", 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.014378993, 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0049219720000000002, 2024-09-17T23:05:35.053 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 121 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944218+0000", 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.054 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944218+0000", 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944218+0000", 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944221+0000", 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4559999999999999e-06 2024-09-17T23:05:35.055 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944227+0000", 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9610000000000002e-06 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944230+0000", 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.76e-06 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944276+0000", 2024-09-17T23:05:35.056 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5473000000000003e-05 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944397+0000", 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000120963 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.949140+0000", 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0047428319999999998 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.057 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:128 2.0 2:17fc906b:::rbd_data.152ffc5dba83.0000000000000038:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.946690+0000", 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.011906846, 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0052393140000000001, 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 128 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:35.058 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946690+0000", 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946690+0000", 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946691+0000", 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:35.059 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946694+0000", 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.8410000000000002e-06 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946702+0000", 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9370000000000004e-06 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946707+0000", 2024-09-17T23:05:35.060 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5759999999999999e-06 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.947012+0000", 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00030548499999999998 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.947141+0000", 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000128918 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.951929+0000", 2024-09-17T23:05:35.061 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0047878469999999996 2024-09-17T23:05:35.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.062 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.062 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:35.062 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:35.062 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:35.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-17T23:05:35.064 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:35.065 INFO:tasks.workunit.client.0.smithi005.stderr:Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2024-09-17T23:05:35.065 INFO:tasks.workunit.client.0.smithi005.stderr:+ set +x 2024-09-17T23:05:35.065 INFO:tasks.workunit.client.0.smithi005.stderr:+ test_rbd_copy 2024-09-17T23:05:35.065 INFO:tasks.workunit.client.0.smithi005.stderr:+ local src=testrbdcopys53757 2024-09-17T23:05:35.065 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd create --size 256 testrbdcopys53757 2024-09-17T23:05:35.065 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdcopy53757 2024-09-17T23:05:35.065 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd copy --image-feature exclusive-lock --image-feature journaling --journal-pool rbd --journal-object-size 20M --journal-splay-width 6 testrbdcopys53757 testrbdcopy53757 2024-09-17T23:05:35.065 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:35.061+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:35.117 INFO:tasks.workunit.client.0.smithi005.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete...2024-09-17T23:05:35.115+0000 7f9d0bfff640 0 -- 172.21.15.5:0/174517881 >> [v2:172.21.15.152:6818/2095030613,v1:172.21.15.152:6819/2095030613] conn(0x7f9cf0004a30 msgr2=0x7f9cf0007430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T23:05:35.124 INFO:tasks.workunit.client.0.smithi005.stderr: Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2024-09-17T23:05:35.128 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdcopys53757 2024-09-17T23:05:35.165 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:35.162+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:35.219 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-17T23:05:35.215+0000 7f75e8b48640 0 -- 172.21.15.5:0/2723272440 >> [v2:172.21.15.152:6802/3030792595,v1:172.21.15.152:6803/3030792595] conn(0x7f75c4008c50 msgr2=0x7f75c400b110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:35.220 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:35.221 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:35.221 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:35.221 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:35.228 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2024-09-17T23:05:35.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:35.231 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdcopy53757 'journal info' //journal/order 25 2024-09-17T23:05:35.231 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdcopy53757 2024-09-17T23:05:35.231 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:35.231 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/order 2024-09-17T23:05:35.231 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=25 2024-09-17T23:05:35.232 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdcopy53757 2024-09-17T23:05:35.232 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/order 2024-09-17T23:05:35.239 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:35.239 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:35.240 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:35.266 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:35.264+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:35.272 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:35.272 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:35.293 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:35.293 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:35.307 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=25 2024-09-17T23:05:35.307 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 25 = 25 2024-09-17T23:05:35.307 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdcopy53757 'journal info' //journal/splay_width 6 2024-09-17T23:05:35.307 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdcopy53757 2024-09-17T23:05:35.307 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:35.307 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/splay_width 2024-09-17T23:05:35.307 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=6 2024-09-17T23:05:35.308 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdcopy53757 2024-09-17T23:05:35.308 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/splay_width 2024-09-17T23:05:35.315 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:35.315 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:35.332 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:35.332 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:35.344 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:35.344 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:35.350 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:05:35.351 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:05:35.354 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:35.354 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:35.355 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:35.363 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=6 2024-09-17T23:05:35.363 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 6 = 6 2024-09-17T23:05:35.363 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdcopy53757 'journal info' //journal/object_pool rbd 2024-09-17T23:05:35.363 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdcopy53757 2024-09-17T23:05:35.363 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:35.363 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/object_pool 2024-09-17T23:05:35.363 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=rbd 2024-09-17T23:05:35.364 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdcopy53757 2024-09-17T23:05:35.364 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/object_pool 2024-09-17T23:05:35.405 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:35.403+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:35.421 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=rbd 2024-09-17T23:05:35.421 INFO:tasks.workunit.client.0.smithi005.stderr:+ test rbd = rbd 2024-09-17T23:05:35.421 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdcopy53757 2024-09-17T23:05:35.468 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:35.465+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:35.473 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:35.473 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:35.482 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:35.498 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete...2024-09-17T23:05:35.496+0000 7f3e4a6bf640 0 -- 172.21.15.5:0/787984978 >> [v2:172.21.15.152:6802/3030792595,v1:172.21.15.152:6803/3030792595] conn(0x7f3e28015ae0 msgr2=0x7f3e280162b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:35.502 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete...2024-09-17T23:05:35.500+0000 7f3e4c122640 0 -- 172.21.15.5:0/787984978 >> [v2:172.21.15.5:6800/3261733059,v1:172.21.15.5:6801/3261733059] conn(0x55d3582d17d0 msgr2=0x55d3582d3bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:35.540 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2024-09-17T23:05:35.544 INFO:tasks.workunit.client.0.smithi005.stderr:+ set +x 2024-09-17T23:05:35.544 INFO:tasks.workunit.client.0.smithi005.stderr:+ test_rbd_clone 2024-09-17T23:05:35.544 INFO:tasks.workunit.client.0.smithi005.stderr:+ local parent=testrbdclonep53757 2024-09-17T23:05:35.544 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd create --image-feature layering --size 256 testrbdclonep53757 2024-09-17T23:05:35.568 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:35.566+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:35.590 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd snap create testrbdclonep53757@snap 2024-09-17T23:05:35.591 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:35.591 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:35.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:35.669 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:35.667+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:35.704 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:35.705 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:35.713 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:35.753 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is set 2024-09-17T23:05:35.758 INFO:tasks.workunit.client.0.smithi005.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2024-09-17T23:05:35.762 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd snap protect testrbdclonep53757@snap 2024-09-17T23:05:35.809 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:35.807+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:35.811 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdclone53757 2024-09-17T23:05:35.811 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd clone --image-feature layering --image-feature exclusive-lock --image-feature journaling --journal-pool rbd --journal-object-size 20M --journal-splay-width 6 testrbdclonep53757@snap testrbdclone53757 2024-09-17T23:05:35.852 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 4] out_osds: [7] dead_osds: [1, 2] live_osds: [0, 3, 4, 5, 6, 7] 2024-09-17T23:05:35.852 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-17T23:05:35.852 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-17T23:05:35.852 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-17T23:05:35.852 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-17T23:05:35.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-17T23:05:35.860 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:35.860 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:35.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:35.903 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdclone53757 'journal info' //journal/order 25 2024-09-17T23:05:35.904 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdclone53757 2024-09-17T23:05:35.904 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:35.904 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/order 2024-09-17T23:05:35.904 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=25 2024-09-17T23:05:35.904 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdclone53757 2024-09-17T23:05:35.904 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/order 2024-09-17T23:05:35.910 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:35.908+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:35.961 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:35.961 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "" 2024-09-17T23:05:35.961 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:35.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=25 2024-09-17T23:05:35.964 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 25 = 25 2024-09-17T23:05:35.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdclone53757 'journal info' //journal/splay_width 6 2024-09-17T23:05:35.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdclone53757 2024-09-17T23:05:35.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:35.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/splay_width 2024-09-17T23:05:35.965 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=6 2024-09-17T23:05:35.965 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdclone53757 2024-09-17T23:05:35.965 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/splay_width 2024-09-17T23:05:35.971 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:35.969+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:36.015 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:36.016 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:36.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:36.026 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=6 2024-09-17T23:05:36.026 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 6 = 6 2024-09-17T23:05:36.027 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdclone53757 'journal info' //journal/object_pool rbd 2024-09-17T23:05:36.027 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdclone53757 2024-09-17T23:05:36.027 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:36.027 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/object_pool 2024-09-17T23:05:36.027 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=rbd 2024-09-17T23:05:36.027 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdclone53757 2024-09-17T23:05:36.027 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/object_pool 2024-09-17T23:05:36.072 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:36.070+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:36.086 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=rbd 2024-09-17T23:05:36.086 INFO:tasks.workunit.client.0.smithi005.stderr:+ test rbd = rbd 2024-09-17T23:05:36.086 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdclone53757 2024-09-17T23:05:36.165 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete...2024-09-17T23:05:36.162+0000 7fab3c815640 0 -- 172.21.15.5:0/1384883881 >> [v2:172.21.15.5:6808/1475101831,v1:172.21.15.5:6809/1475101831] conn(0x7fab140665f0 msgr2=0x7fab1406dfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T23:05:36.173 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete...2024-09-17T23:05:36.170+0000 7fab32db2640 0 -- 172.21.15.5:0/1384883881 >> [v2:172.21.15.152:6802/3030792595,v1:172.21.15.152:6803/3030792595] conn(0x7fab140053e0 msgr2=0x7fab140077d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:36.173 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:36.170+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:36.177 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:36.177 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:36.186 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:36.274 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:36.272+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:36.328 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:36.328 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:36.337 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:36.381 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:36.378+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:36.385 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2024-09-17T23:05:36.388 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd snap unprotect testrbdclonep53757@snap 2024-09-17T23:05:36.436 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd snap purge testrbdclonep53757 2024-09-17T23:05:36.443 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:36.443 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:36.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:36.474 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:36.472+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:36.576 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:36.574+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:36.595 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:36.595 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:36.604 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:36.689 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:36.687+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:36.748 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:36.748 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:36.758 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:05:36.758 INFO:tasks.workunit.client.0.smithi005.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2024-09-17T23:05:36.762 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdclonep53757 2024-09-17T23:05:36.799 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:36.797+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:36.835 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete...2024-09-17T23:05:36.832+0000 7fba61204640 0 -- 172.21.15.5:0/3178050601 >> [v2:172.21.15.152:6818/2095030613,v1:172.21.15.152:6819/2095030613] conn(0x556f9322bfe0 msgr2=0x556f9322e470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:36.838 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2024-09-17T23:05:36.836+0000 7fba58a03640 0 -- 172.21.15.5:0/3178050601 >> [v2:172.21.15.5:6800/3261733059,v1:172.21.15.5:6801/3261733059] conn(0x556f931d9970 msgr2=0x556f931dbd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:36.847 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 100% complete...done. 2024-09-17T23:05:36.851 INFO:tasks.workunit.client.0.smithi005.stderr:+ set +x 2024-09-17T23:05:36.851 INFO:tasks.workunit.client.0.smithi005.stderr:+ test_rbd_import 2024-09-17T23:05:36.851 INFO:tasks.workunit.client.0.smithi005.stderr:+ local src=testrbdimports53757 2024-09-17T23:05:36.851 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd create --size 256 testrbdimports53757 2024-09-17T23:05:36.879 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:36.877+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:36.898 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd export testrbdimports53757 /tmp/rbd_journal53757/testrbdimports53757.export 2024-09-17T23:05:36.908 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:36.908 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:36.917 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:05:36.975 INFO:tasks.workunit.client.0.smithi005.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2024-09-17T23:05:36.980 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:36.978+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:36.981 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdimports53757 2024-09-17T23:05:37.024 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:37.024 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:37.033 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:05:37.073 INFO:tasks.workunit.client.0.smithi005.stderr:2024-09-17T23:05:37.071+0000 7ff2efa83640 0 -- 172.21.15.5:0/1078520613 >> [v2:172.21.15.152:6802/3030792595,v1:172.21.15.152:6803/3030792595] conn(0x7ff2dc008c50 msgr2=0x7ff2dc00b110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:37.081 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:37.079+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:37.085 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2024-09-17T23:05:37.088 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdimport53757 2024-09-17T23:05:37.088 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd import --image-feature exclusive-lock --image-feature journaling --journal-pool rbd --journal-object-size 20M --journal-splay-width 6 /tmp/rbd_journal53757/testrbdimports53757.export testrbdimport53757 2024-09-17T23:05:37.179 INFO:teuthology.orchestra.run.smithi152.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:37.179 INFO:teuthology.orchestra.run.smithi152.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:37.182 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:37.180+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:37.188 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-17T23:05:37.279 INFO:tasks.workunit.client.0.smithi005.stderr: Importing image: 1% complete... Importing image: 3% complete... Importing image: 4% complete... Importing image: 6% complete... Importing image: 7% complete... Importing image: 9% complete... Importing image: 10% complete... Importing image: 12% complete... Importing image: 14% complete... Importing image: 15% complete... Importing image: 17% complete... Importing image: 18% complete... Importing image: 20% complete... Importing image: 21% complete... Importing image: 23% complete... Importing image: 25% complete... Importing image: 26% complete... Importing image: 28% complete... Importing image: 29% complete... Importing image: 31% complete... Importing image: 32% complete... Importing image: 34% complete... Importing image: 35% complete... Importing image: 37% complete... Importing image: 39% complete... Importing image: 40% complete... Importing image: 42% complete... Importing image: 43% complete... Importing image: 45% complete... Importing image: 46% complete... Importing image: 48% complete... Importing image: 50% complete... Importing image: 51% complete... Importing image: 53% complete... Importing image: 54% complete... Importing image: 56% complete... Importing image: 57% complete... Importing image: 59% complete... Importing image: 60% complete... Importing image: 62% complete... Importing image: 64% complete... Importing image: 65% complete... Importing image: 67% complete... Importing image: 68% complete... Importing image: 70% complete... Importing image: 71% complete... Importing image: 73% complete... Importing image: 75% complete... Importing image: 76% complete... Importing image: 78% complete... Importing image: 79% complete... Importing image: 81% complete... Importing image: 82% complete... Importing image: 84% complete... Importing image: 85% complete... Importing image: 87% complete... Importing image: 89% complete... Importing image: 90% complete... Importing image: 92% complete... Importing image: 93% complete... Importing image: 95% complete... Importing image: 96% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2024-09-17T23:05:37.283 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:37.281+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:37.283 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdimport53757 'journal info' //journal/order 25 2024-09-17T23:05:37.283 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdimport53757 2024-09-17T23:05:37.284 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:37.284 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/order 2024-09-17T23:05:37.284 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=25 2024-09-17T23:05:37.284 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdimport53757 2024-09-17T23:05:37.284 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/order 2024-09-17T23:05:37.308 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:37.309 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:37.318 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-17T23:05:37.338 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=25 2024-09-17T23:05:37.338 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 25 = 25 2024-09-17T23:05:37.338 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdimport53757 'journal info' //journal/splay_width 6 2024-09-17T23:05:37.338 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdimport53757 2024-09-17T23:05:37.339 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:37.339 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/splay_width 2024-09-17T23:05:37.339 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=6 2024-09-17T23:05:37.339 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdimport53757 2024-09-17T23:05:37.339 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/splay_width 2024-09-17T23:05:37.356 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-17T23:05:37.383 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:37.381+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:37.399 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=6 2024-09-17T23:05:37.399 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 6 = 6 2024-09-17T23:05:37.399 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdimport53757 'journal info' //journal/object_pool rbd 2024-09-17T23:05:37.399 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdimport53757 2024-09-17T23:05:37.400 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:37.400 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/object_pool 2024-09-17T23:05:37.400 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=rbd 2024-09-17T23:05:37.400 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdimport53757 2024-09-17T23:05:37.400 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/object_pool 2024-09-17T23:05:37.457 INFO:teuthology.orchestra.run.smithi005.stdout:ERROR: (22) Invalid argument 2024-09-17T23:05:37.457 INFO:teuthology.orchestra.run.smithi005.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-17T23:05:37.458 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=rbd 2024-09-17T23:05:37.458 INFO:tasks.workunit.client.0.smithi005.stderr:+ test rbd = rbd 2024-09-17T23:05:37.458 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdimport53757 2024-09-17T23:05:37.467 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-17T23:05:37.509 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:37.507+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:37.511 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0: {} 2024-09-17T23:05:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-17T23:05:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.1 2024-09-17T23:05:37.512 INFO:teuthology.orchestra.run.smithi005.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-09-17T23:05:37.532 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3: {} 2024-09-17T23:05:37.532 INFO:teuthology.orchestra.run.smithi005.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-17T23:05:37.546 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete...2024-09-17T23:05:37.544+0000 7f2a30d74640 0 -- 172.21.15.5:0/1191893428 >> [v2:172.21.15.5:6800/3261733059,v1:172.21.15.5:6801/3261733059] conn(0x557c4d481f00 msgr2=0x557c4d4842f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:37.550 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete...2024-09-17T23:05:37.548+0000 7f2a2fb12640 0 -- 172.21.15.5:0/1191893428 >> [v2:172.21.15.152:6818/2095030613,v1:172.21.15.152:6819/2095030613] conn(0x557c4d4d4630 msgr2=0x557c4d4d6ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:37.555 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4: {} 2024-09-17T23:05:37.555 INFO:teuthology.orchestra.run.smithi005.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-17T23:05:37.575 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5: {} 2024-09-17T23:05:37.575 INFO:teuthology.orchestra.run.smithi005.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-17T23:05:37.581 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2024-09-17T23:05:37.585 INFO:tasks.workunit.client.0.smithi005.stderr:+ set +x 2024-09-17T23:05:37.585 INFO:tasks.workunit.client.0.smithi005.stderr:+ test_rbd_feature 2024-09-17T23:05:37.585 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdfeature53757 2024-09-17T23:05:37.585 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd create --image-feature exclusive-lock --size 256 testrbdfeature53757 2024-09-17T23:05:37.585 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:37.583+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:37.593 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6: {} 2024-09-17T23:05:37.593 INFO:teuthology.orchestra.run.smithi005.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-17T23:05:37.610 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7: {} 2024-09-17T23:05:37.610 INFO:teuthology.orchestra.run.smithi005.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-17T23:05:37.613 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-09-17T23:05:37.614 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.4941.0:26 2.0 2.925b1538 (undecoded) ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e88)", 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 29.411392326000001, 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 21.517741609000002, 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.631 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "reached pg", 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.4941", 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.632 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216371+0000", 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216374+0000", 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.3590000000000002e-06 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216385+0000", 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.145e-05 2024-09-17T23:05:37.633 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216405+0000", 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9568999999999998e-05 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:08.216413+0000", 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5990000000000002e-06 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.634 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.729688+0000", 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 20.513274776999999 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "waiting for peered", 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:28.729701+0000", 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.314e-05 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:29.734099+0000", 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.004397497 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.635 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:29.734113+0000", 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4218e-05 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5411.0:121 2.0 2:167788c7:::journal.14d56a47625e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.865171+0000", 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 3.762592814, 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0046037530000000004, 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.636 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5411", 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 121 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865171+0000", 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.637 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865171+0000", 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865171+0000", 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.5699999999999998e-07 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865173+0000", 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.2589999999999999e-06 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.638 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865177+0000", 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.8469999999999998e-06 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865180+0000", 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9799999999999998e-06 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865489+0000", 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00030918900000000002 2024-09-17T23:05:37.639 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865541+0000", 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1588999999999997e-05 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "waiting for subops from 7", 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.865605+0000", 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.4375000000000006e-05 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.640 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.866018+0000", 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00041303299999999999 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.869671+0000", 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.003653023 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.869704+0000", 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2608999999999999e-05 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.641 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.869774+0000", 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.0492000000000002e-05 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:83 2.0 2:068c927a:::rbd_data.132cc2a15bff.000000000000000c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.962106+0000", 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 3.6656578479999999, 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0034350140000000001, 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.642 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 83 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962106+0000", 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.643 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962106+0000", 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962107+0000", 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.64e-07 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962111+0000", 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.746e-06 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.644 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962124+0000", 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2413e-05 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962131+0000", 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.5870000000000004e-06 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962201+0000", 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.9307000000000006e-05 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.645 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.962435+0000", 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00023452100000000001 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965541+0000", 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0031054759999999998 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:96 2.0 2:040098b5:::rbd_data.132cc2a15bff.0000000000000019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.646 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.965497+0000", 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 3.6622661010000002, 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.002835405, 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 96 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.647 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965497+0000", 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965497+0000", 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965499+0000", 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.054e-06 2024-09-17T23:05:37.648 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965505+0000", 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7689999999999999e-06 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965525+0000", 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.9278000000000001e-05 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965528+0000", 2024-09-17T23:05:37.649 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.1549999999999999e-06 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965573+0000", 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5232000000000003e-05 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.965672+0000", 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.9135999999999994e-05 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.968333+0000", 2024-09-17T23:05:37.650 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0026607810000000001 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:117 2.0 2:1ca8da49:::journal_data.2.132cc2a15bff.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e103)", 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.581259+0000", 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 3.0465045499999999, 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0027850129999999998, 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:37.651 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 117 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581259+0000", 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581259+0000", 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.652 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581262+0000", 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0910000000000001e-06 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581274+0000", 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2e-05 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581297+0000", 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.2802e-05 2024-09-17T23:05:37.653 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581306+0000", 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.3179999999999996e-06 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581392+0000", 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6131999999999995e-05 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.581493+0000", 2024-09-17T23:05:37.654 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000100577 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.584044+0000", 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0025510929999999999 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:85 2.0 2:05735b28:::rbd_data.152ffc5dba83.000000000000000e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.932896+0000", 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.694867704, 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0031417089999999999, 2024-09-17T23:05:37.655 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 85 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932896+0000", 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.656 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932896+0000", 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932897+0000", 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.8299999999999995e-07 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932901+0000", 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2699999999999998e-06 2024-09-17T23:05:37.657 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932911+0000", 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0190999999999999e-05 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932918+0000", 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.6150000000000002e-06 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.932981+0000", 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3139000000000007e-05 2024-09-17T23:05:37.658 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.933100+0000", 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000119298 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.936038+0000", 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.002937313 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.659 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:88 2.0 2:0ac9897f:::rbd_data.152ffc5dba83.0000000000000010:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.934339+0000", 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.6934241189999999, 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0042441800000000002, 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 88 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.660 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934339+0000", 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934339+0000", 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934340+0000", 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4900000000000001e-07 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.661 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934343+0000", 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8600000000000001e-06 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934351+0000", 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8299999999999996e-06 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934357+0000", 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1279999999999996e-06 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.662 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934460+0000", 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010366600000000001 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.934611+0000", 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00015087999999999999 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.938584+0000", 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0039723670000000001 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.663 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:110 2.0 2:10b4ad11:::rbd_data.152ffc5dba83.0000000000000026:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.940075+0000", 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.6876882869999998, 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0038269020000000001, 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.664 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 110 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940075+0000", 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940075+0000", 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.665 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940076+0000", 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5499999999999997e-07 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940080+0000", 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6090000000000001e-06 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940089+0000", 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.9050000000000003e-06 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.666 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940094+0000", 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1590000000000001e-06 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940137+0000", 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3575999999999997e-05 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940208+0000", 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.0593000000000007e-05 2024-09-17T23:05:37.667 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.943902+0000", 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0036942049999999999 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:111 2.0 2:066f7604:::rbd_data.152ffc5dba83.0000000000000027:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.940106+0000", 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.68765754, 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0039373209999999997, 2024-09-17T23:05:37.668 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 111 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940106+0000", 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.669 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940106+0000", 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940106+0000", 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2500000000000001e-07 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940117+0000", 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0282000000000001e-05 2024-09-17T23:05:37.670 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940125+0000", 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9629999999999998e-06 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940133+0000", 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4500000000000004e-06 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940404+0000", 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00027054299999999999 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.671 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940486+0000", 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2095999999999995e-05 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944043+0000", 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0035575619999999998 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.672 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:112 2.0 2:07e0d52b:::rbd_data.152ffc5dba83.0000000000000028:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.940143+0000", 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.6876208849999998, 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0064686070000000003, 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 112 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.673 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940143+0000", 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940143+0000", 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940143+0000", 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.1299999999999999e-07 2024-09-17T23:05:37.674 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940146+0000", 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.2790000000000001e-06 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940153+0000", 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7789999999999998e-06 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940157+0000", 2024-09-17T23:05:37.675 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.729e-06 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940688+0000", 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00053037199999999998 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.940821+0000", 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000133805 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.676 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946611+0000", 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0057898300000000002 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:114 2.0 2:1f546182:::rbd_data.152ffc5dba83.000000000000002a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.941241+0000", 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.6865221419999998, 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0055991820000000003, 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.677 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 114 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941241+0000", 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941241+0000", 2024-09-17T23:05:37.678 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941242+0000", 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.7899999999999997e-07 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941248+0000", 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4319999999999998e-06 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.679 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941256+0000", 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4470000000000006e-06 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941261+0000", 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0420000000000002e-06 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941308+0000", 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7070999999999997e-05 2024-09-17T23:05:37.680 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.941380+0000", 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.1926000000000002e-05 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946841+0000", 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0054604850000000002 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.681 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:117 2.0 2:15e34b47:::rbd_data.152ffc5dba83.000000000000002d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.942633+0000", 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.6851310320000001, 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0043451030000000003, 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 117 2024-09-17T23:05:37.682 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942633+0000", 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942633+0000", 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.683 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942633+0000", 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.0200000000000001e-07 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942637+0000", 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9570000000000004e-06 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942647+0000", 2024-09-17T23:05:37.684 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.312e-06 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942651+0000", 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3780000000000003e-06 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942700+0000", 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8730999999999998e-05 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.685 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.942833+0000", 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000133118 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946978+0000", 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0041448049999999997 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:121 2.0 2:050a4296:::rbd_data.152ffc5dba83.0000000000000031:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.686 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.944218+0000", 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.683545836, 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0049219720000000002, 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 121 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.687 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944218+0000", 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944218+0000", 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.688 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944218+0000", 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.2699999999999999e-07 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944221+0000", 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4559999999999999e-06 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944227+0000", 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9610000000000002e-06 2024-09-17T23:05:37.689 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944230+0000", 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.76e-06 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944276+0000", 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5473000000000003e-05 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.944397+0000", 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000120963 2024-09-17T23:05:37.690 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.949140+0000", 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0047428319999999998 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:128 2.0 2:17fc906b:::rbd_data.152ffc5dba83.0000000000000038:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.946690+0000", 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.6810736889999998, 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0052393140000000001, 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.691 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 128 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946690+0000", 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.692 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946690+0000", 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946691+0000", 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.0999999999999998e-07 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946694+0000", 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.8410000000000002e-06 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.693 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946702+0000", 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9370000000000004e-06 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.946707+0000", 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.5759999999999999e-06 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.947012+0000", 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00030548499999999998 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.694 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.947141+0000", 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000128918 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.951929+0000", 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0047878469999999996 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:150 2.0 2:06fd94c2:::journal_data.2.152ffc5dba83.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e103)", 2024-09-17T23:05:37.695 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.962150+0000", 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.6656138220000001, 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0024576849999999998, 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 150 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.696 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962150+0000", 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962150+0000", 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962151+0000", 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1939999999999999e-06 2024-09-17T23:05:37.697 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962157+0000", 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3960000000000003e-06 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962174+0000", 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6429000000000001e-05 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962181+0000", 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.5630000000000003e-06 2024-09-17T23:05:37.698 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962249+0000", 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7704000000000001e-05 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962381+0000", 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000131867 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.964607+0000", 2024-09-17T23:05:37.699 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0022265319999999998 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5459.0:154 2.0 2:1e955b8f:::journal_data.2.152ffc5dba83.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+full_force+supports_pool_eio e103)", 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.962239+0000", 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 2.6655248719999998, 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0025812370000000001, 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.700 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5459", 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 154 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962239+0000", 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.701 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962239+0000", 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962239+0000", 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.32e-07 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962242+0000", 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.6299999999999998e-06 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.702 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962246+0000", 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4190000000000004e-06 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962249+0000", 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.066e-06 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962726+0000", 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00047679999999999999 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.703 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.962804+0000", 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8152000000000007e-05 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.964820+0000", 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.002015738 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6162.0:81 2.0 2:12bcd88a:::rbd_data.17e8eb94ce63.000000000000000a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:37.704 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.540068+0000", 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.087695124999999999, 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0031245890000000001, 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6162", 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1191893428", 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 81 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.705 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.540068+0000", 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.540068+0000", 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.540069+0000", 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6700000000000002e-07 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.706 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.540074+0000", 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2320000000000003e-06 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.540087+0000", 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3237999999999999e-05 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.540095+0000", 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.8790000000000003e-06 2024-09-17T23:05:37.707 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.540152+0000", 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7651000000000001e-05 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.540227+0000", 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.5036000000000005e-05 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.708 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.543193+0000", 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0029656859999999999 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6162.0:119 2.0 2:0f7a32ca:::rbd_data.17e8eb94ce63.000000000000002f:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.551749+0000", 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.076014936000000005, 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.003005284, 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.709 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6162", 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1191893428", 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 119 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551749+0000", 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551749+0000", 2024-09-17T23:05:37.710 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551749+0000", 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5899999999999995e-07 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551754+0000", 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.729e-06 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551763+0000", 2024-09-17T23:05:37.711 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.2909999999999996e-06 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551770+0000", 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3489999999999997e-06 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551852+0000", 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2478999999999994e-05 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551984+0000", 2024-09-17T23:05:37.712 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000131237 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.554754+0000", 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00277034 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6162.0:131 2.0 2:0798db74:::rbd_data.17e8eb94ce63.000000000000003b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.557607+0000", 2024-09-17T23:05:37.713 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.070156218000000006, 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0028085359999999999, 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6162", 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1191893428", 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 131 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557607+0000", 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.714 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557607+0000", 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557608+0000", 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.4300000000000002e-07 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557612+0000", 2024-09-17T23:05:37.715 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9500000000000003e-06 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557622+0000", 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.55e-06 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557632+0000", 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0698e-05 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.716 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557688+0000", 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5674000000000003e-05 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557783+0000", 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.5433999999999995e-05 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.560416+0000", 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0026323869999999999 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.717 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6162.0:135 2.0 2:199b6695:::rbd_data.17e8eb94ce63.000000000000003f:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.557823+0000", 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.069940714000000001, 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0029175949999999998, 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6162", 2024-09-17T23:05:37.718 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1191893428", 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 135 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557823+0000", 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557823+0000", 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.719 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557824+0000", 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.4300000000000002e-07 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557827+0000", 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.3589999999999999e-06 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557836+0000", 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6580000000000008e-06 2024-09-17T23:05:37.720 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.557840+0000", 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3900000000000003e-06 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.558029+0000", 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00018927700000000001 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.558171+0000", 2024-09-17T23:05:37.721 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00014221500000000001 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.560740+0000", 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0025689530000000001 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:37.722 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:37.723 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd feature enable testrbdfeature53757 journaling --journal-pool rbd --journal-object-size 20M --journal-splay-width 6 2024-09-17T23:05:37.724 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-17T23:05:37.725 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdfeature53757 'journal info' //journal/order 25 2024-09-17T23:05:37.725 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdfeature53757 2024-09-17T23:05:37.725 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:37.725 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/order 2024-09-17T23:05:37.725 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=25 2024-09-17T23:05:37.725 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdfeature53757 2024-09-17T23:05:37.725 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/order 2024-09-17T23:05:37.725 INFO:tasks.ceph.osd.7.smithi152.stderr:2024-09-17T23:05:37.721+0000 7f6d4f6cd640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 53088) UID: 0 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=25 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 25 = 25 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdfeature53757 'journal info' //journal/splay_width 6 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdfeature53757 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/splay_width 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=6 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdfeature53757 2024-09-17T23:05:37.746 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/splay_width 2024-09-17T23:05:37.770 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=6 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ test 6 = 6 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd_assert_eq testrbdfeature53757 'journal info' //journal/object_pool rbd 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ local image=testrbdfeature53757 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ local 'cmd=journal info' 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ local param=//journal/object_pool 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:+ local expected_val=rbd 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:++ rbd --format xml journal info --image testrbdfeature53757 2024-09-17T23:05:37.803 INFO:tasks.workunit.client.0.smithi005.stderr:++ xmlstarlet sel -t -v //journal/object_pool 2024-09-17T23:05:37.824 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:37.822+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:37.862 INFO:tasks.workunit.client.0.smithi005.stderr:+ local val=rbd 2024-09-17T23:05:37.862 INFO:tasks.workunit.client.0.smithi005.stderr:+ test rbd = rbd 2024-09-17T23:05:37.862 INFO:tasks.workunit.client.0.smithi005.stderr:+ rbd remove testrbdfeature53757 2024-09-17T23:05:37.863 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:37.863 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:37.863 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:37.872 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-17T23:05:37.925 INFO:tasks.ceph.osd.5.smithi152.stderr:2024-09-17T23:05:37.923+0000 7f5586b70640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 33755) UID: 0 2024-09-17T23:05:37.953 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete...2024-09-17T23:05:37.950+0000 7f60084b8640 0 -- 172.21.15.5:0/4159906226 >> [v2:172.21.15.152:6818/2095030613,v1:172.21.15.152:6819/2095030613] conn(0x55f0ebfa0510 msgr2=0x55f0ebfa29a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-17T23:05:37.958 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete...2024-09-17T23:05:37.956+0000 7f6007cb7640 0 -- 172.21.15.5:0/4159906226 >> [v2:172.21.15.5:6808/1475101831,v1:172.21.15.5:6809/1475101831] conn(0x7f5fec008c50 msgr2=0x7f5fec00b110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-17T23:05:37.979 INFO:tasks.workunit.client.0.smithi005.stderr: Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2024-09-17T23:05:37.983 INFO:tasks.workunit.client.0.smithi005.stderr:+ set +x 2024-09-17T23:05:37.983 INFO:tasks.workunit.client.0.smithi005.stdout:OK 2024-09-17T23:05:38.016 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-17T23:05:38.016 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-17T23:05:38.031 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:38.031 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:38.031 INFO:teuthology.orchestra.run.smithi005.stdout: "complaint_time": 30, 2024-09-17T23:05:38.032 INFO:teuthology.orchestra.run.smithi005.stdout: "num_blocked_ops": 0 2024-09-17T23:05:38.032 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:38.032 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:38.029+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:38.041 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-17T23:05:38.056 INFO:tasks.workunit:Stopping ['rbd/journal.sh'] on client.0... 2024-09-17T23:05:38.057 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-17T23:05:38.127 INFO:tasks.ceph.osd.6.smithi152.stderr:2024-09-17T23:05:38.125+0000 7f02f1729640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 33756) UID: 0 2024-09-17T23:05:38.206 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "size": 20, 2024-09-17T23:05:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 600, 2024-09-17T23:05:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [ 2024-09-17T23:05:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:25 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201650+0000", 2024-09-17T23:05:38.206 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0012520890000003, 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0035161960000000001, 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 25 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201650+0000", 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.207 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201650+0000", 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201651+0000", 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2359999999999999e-06 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201658+0000", 2024-09-17T23:05:38.208 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8029999999999999e-06 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201666+0000", 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.3680000000000002e-06 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201672+0000", 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7629999999999997e-06 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.209 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201720+0000", 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8649000000000001e-05 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201777+0000", 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.6174999999999997e-05 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205053+0000", 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.003276508 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.210 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205092+0000", 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.8513999999999998e-05 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205166+0000", 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.4179999999999998e-05 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.211 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:26 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201687+0000", 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0012146069999996, 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00437112, 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 26 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.212 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201687+0000", 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201687+0000", 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201688+0000", 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.4799999999999999e-07 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.213 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201694+0000", 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7190000000000004e-06 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201701+0000", 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3820000000000001e-06 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201706+0000", 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0200000000000002e-06 2024-09-17T23:05:38.214 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.202369+0000", 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000663388 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.202425+0000", 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5788000000000002e-05 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.215 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205967+0000", 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0035417999999999999 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205995+0000", 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8246999999999999e-05 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206058+0000", 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3328000000000001e-05 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.216 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:27 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 8192~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201722+0000", 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0011795110000001, 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0044270960000000002, 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 27 2024-09-17T23:05:38.217 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201722+0000", 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201722+0000", 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.218 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201723+0000", 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8299999999999997e-07 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201732+0000", 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.115e-06 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201739+0000", 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.1949999999999997e-06 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.219 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201744+0000", 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4049999999999999e-06 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.202800+0000", 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001055652 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.202858+0000", 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.8312e-05 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.220 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206063+0000", 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0032050669999999998 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206090+0000", 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.6322e-05 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206149+0000", 2024-09-17T23:05:38.221 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9545e-05 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:28 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 12288~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201751+0000", 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0011511320000004, 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0044852659999999999, 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.222 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 28 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201751+0000", 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201751+0000", 2024-09-17T23:05:38.223 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201751+0000", 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.77e-07 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201756+0000", 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5249999999999996e-06 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.224 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201761+0000", 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.0600000000000001e-06 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201767+0000", 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2709999999999998e-06 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.203194+0000", 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0014275469999999999 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.225 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.203241+0000", 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6214999999999997e-05 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206155+0000", 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0029140009999999998 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206180+0000", 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5680000000000001e-05 2024-09-17T23:05:38.226 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206236+0000", 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5590000000000001e-05 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:29 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 16384~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201772+0000", 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.001130055, 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0045542569999999999, 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.227 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 29 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201772+0000", 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.228 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201772+0000", 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201772+0000", 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.2100000000000001e-07 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201776+0000", 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.895e-06 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.229 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201780+0000", 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3939999999999998e-06 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201783+0000", 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7149999999999998e-06 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.203533+0000", 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001750482 2024-09-17T23:05:38.230 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.203577+0000", 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.3321000000000001e-05 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206241+0000", 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.002663959 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206267+0000", 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.6803000000000001e-05 2024-09-17T23:05:38.231 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206326+0000", 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.8467000000000001e-05 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:30 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 20480~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201787+0000", 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0011148600000004, 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0046257069999999997, 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.232 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 30 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201787+0000", 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.233 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201787+0000", 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201787+0000", 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4600000000000001e-07 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201791+0000", 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.5039999999999998e-06 2024-09-17T23:05:38.234 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201794+0000", 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.5109999999999999e-06 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201797+0000", 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.6539999999999999e-06 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.203890+0000", 2024-09-17T23:05:38.235 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0020934270000000001 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.203942+0000", 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1966999999999999e-05 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206331+0000", 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.002388556 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.236 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206357+0000", 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5978000000000001e-05 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206413+0000", 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5863999999999999e-05 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:31 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 24576~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.237 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201800+0000", 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0011014950000003, 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.004701996, 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 31 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.238 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201800+0000", 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201800+0000", 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201800+0000", 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.1299999999999999e-07 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.239 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201817+0000", 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6668e-05 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201823+0000", 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.7690000000000002e-06 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201826+0000", 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.174e-06 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.240 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.204301+0000", 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00247503 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.204351+0000", 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0260000000000003e-05 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206420+0000", 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00206901 2024-09-17T23:05:38.241 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206446+0000", 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.6183999999999999e-05 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206502+0000", 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5687999999999999e-05 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.242 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:32 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 28672~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201832+0000", 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0010701539999998, 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0047559489999999998, 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 32 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.243 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201832+0000", 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201832+0000", 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201832+0000", 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8999999999999998e-07 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.244 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201837+0000", 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8420000000000004e-06 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201840+0000", 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.7179999999999998e-06 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201843+0000", 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7190000000000001e-06 2024-09-17T23:05:38.245 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.204697+0000", 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0028540369999999998 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.204743+0000", 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6090000000000001e-05 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206507+0000", 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0017637849999999999 2024-09-17T23:05:38.246 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206533+0000", 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.6293999999999999e-05 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206587+0000", 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4174e-05 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.247 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:33 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 32768~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201847+0000", 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0010549429999998, 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0048243110000000004, 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 33 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.248 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201847+0000", 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201847+0000", 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201847+0000", 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.22e-07 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.249 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201851+0000", 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.585e-06 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201854+0000", 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.4429999999999999e-06 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201857+0000", 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5409999999999999e-06 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.250 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205204+0000", 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0033473029999999998 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205260+0000", 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.5989999999999998e-05 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206592+0000", 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001332436 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.251 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206618+0000", 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.5497999999999999e-05 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206671+0000", 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3292999999999999e-05 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5868.0:34 2.1 2:9864bd46:::rbd_data.14d56a47625e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 36864~4096] snapc 3=[3] ondisk+write+known_if_redirected+full_try+supports_pool_eio e102)", 2024-09-17T23:05:38.252 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:33.201860+0000", 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 5.0010416700000002, 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0051183410000000002, 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5868", 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/333054240", 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 34 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.253 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201860+0000", 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201860+0000", 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201860+0000", 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.2499999999999999e-07 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.254 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201872+0000", 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.1995e-05 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201876+0000", 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1989999999999999e-06 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.201880+0000", 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.2909999999999999e-06 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.255 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205606+0000", 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0037261460000000001 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.205656+0000", 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.0396000000000003e-05 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206899+0000", 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001243107 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.256 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206927+0000", 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.7223e-05 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:33.206978+0000", 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.1758999999999997e-05 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.257 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:82 2.1 2:8de17671:::rbd_data.132cc2a15bff.000000000000000b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.564481+0000", 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 3.6384203360000003, 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0013915030000000001, 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 82 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.258 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564481+0000", 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564481+0000", 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564483+0000", 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.0470000000000001e-06 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564490+0000", 2024-09-17T23:05:38.259 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8539999999999999e-06 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564503+0000", 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.2401999999999999e-05 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564511+0000", 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.2500000000000006e-06 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564579+0000", 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.8372000000000002e-05 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564683+0000", 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00010328900000000001 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.565873+0000", 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001190289 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:91 2.1 2:8dcb0b2e:::rbd_data.132cc2a15bff.0000000000000014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.564535+0000", 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 3.6383665779999999, 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001473469, 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:38.262 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 91 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564535+0000", 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564535+0000", 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.263 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564536+0000", 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8299999999999997e-07 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564541+0000", 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9559999999999996e-06 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564554+0000", 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.3633e-05 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.264 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564563+0000", 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.49e-06 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564948+0000", 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00038538100000000002 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.565109+0000", 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00016102 2024-09-17T23:05:38.265 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.566009+0000", 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000899506 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.5883.0:98 2.1 2:9f4839fe:::rbd_data.132cc2a15bff.000000000000001b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:34.564577+0000", 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 3.6383250079999998, 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001563247, 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.266 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.5883", 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 98 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564577+0000", 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564577+0000", 2024-09-17T23:05:38.267 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564577+0000", 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.6699999999999999e-07 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564580+0000", 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.852e-06 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564591+0000", 2024-09-17T23:05:38.268 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.0579e-05 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.564595+0000", 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1320000000000004e-06 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.565407+0000", 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00081267500000000001 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.269 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.565521+0000", 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000113201 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:34.566140+0000", 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00061934100000000003 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6162.0:98 2.1 2:92ed60fc:::rbd_data.17e8eb94ce63.000000000000001a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.546925+0000", 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.65597632100000003, 2024-09-17T23:05:38.270 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0016585230000000001, 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6162", 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1191893428", 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 98 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.546925+0000", 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.271 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.546925+0000", 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.546926+0000", 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.4000000000000002e-07 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.546929+0000", 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.8399999999999999e-06 2024-09-17T23:05:38.272 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.546937+0000", 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.994e-06 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.546943+0000", 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.3539999999999996e-06 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547261+0000", 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00031789900000000001 2024-09-17T23:05:38.273 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547410+0000", 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.000148682 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.548584+0000", 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001174214 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.274 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6162.0:99 2.1 2:9343f858:::rbd_data.17e8eb94ce63.000000000000001b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.547537+0000", 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.65536418299999999, 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011555350000000001, 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6162", 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1191893428", 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 99 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.275 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547537+0000", 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547537+0000", 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547538+0000", 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.6700000000000002e-07 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.276 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547543+0000", 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.9359999999999998e-06 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547552+0000", 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.5550000000000003e-06 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.277 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547557+0000", 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.7820000000000001e-06 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547761+0000", 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00020413300000000001 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.547890+0000", 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00012885800000000001 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.278 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.548693+0000", 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00080340399999999997 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6162.0:111 2.1 2:829a07d6:::rbd_data.17e8eb94ce63.0000000000000027:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.549865+0000", 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.65303642900000003, 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011831630000000001, 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.279 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6162", 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/1191893428", 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 111 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.549865+0000", 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.549865+0000", 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.280 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.549866+0000", 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7700000000000004e-07 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.549870+0000", 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.9280000000000003e-06 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.549879+0000", 2024-09-17T23:05:38.281 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.4499999999999993e-06 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.549887+0000", 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.7419999999999997e-06 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.550312+0000", 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00042459399999999998 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.550429+0000", 2024-09-17T23:05:38.282 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00011773 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.551048+0000", 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00061904199999999999 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6219.0:43 2.1 2:895de044:::rbd_header.181b6e819781:head [watch unwatch cookie 140049756807792] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.930355+0000", 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.27254692699999999, 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011719510000000001, 2024-09-17T23:05:38.283 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6219", 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 43 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.930355+0000", 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.284 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.930355+0000", 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.930355+0000", 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.6300000000000001e-07 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.930357+0000", 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6449999999999999e-06 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.285 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.930363+0000", 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.9800000000000003e-06 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.930366+0000", 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 3.0910000000000001e-06 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.930573+0000", 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00020675000000000001 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.286 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.930653+0000", 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.9966e-05 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "op_commit", 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.931401+0000", 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00074846899999999998 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "commit_sent", 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.931431+0000", 2024-09-17T23:05:38.287 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.9716000000000001e-05 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.931527+0000", 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.5971000000000007e-05 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6219.0:74 2.1 2:897694d7:::rbd_data.181b6e819781.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.947898+0000", 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.25500347200000001, 2024-09-17T23:05:38.288 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001129288, 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6219", 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 74 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947898+0000", 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947898+0000", 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947899+0000", 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 7.2900000000000003e-07 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.290 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947903+0000", 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.1980000000000003e-06 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947917+0000", 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.4239999999999999e-05 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947926+0000", 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.8510000000000005e-06 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.291 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947994+0000", 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.7385999999999995e-05 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.948090+0000", 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.6204000000000003e-05 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.949027+0000", 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00093767999999999998 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.292 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6219.0:76 2.1 2:804594aa:::rbd_data.181b6e819781.0000000000000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.947959+0000", 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.25494241099999998, 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001420742, 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6219", 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 76 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.293 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947959+0000", 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947959+0000", 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947960+0000", 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 5.3000000000000001e-07 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.294 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947965+0000", 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.8189999999999999e-06 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947973+0000", 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 8.0700000000000007e-06 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.947979+0000", 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.1340000000000001e-06 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.295 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.948245+0000", 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00026572899999999998 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.948307+0000", 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2071999999999998e-05 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.949380+0000", 2024-09-17T23:05:38.296 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.001073388 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "description": "osd_op(client.6219.0:110 2.1 2:895de044:::rbd_header.181b6e819781:head [watch reconnect cookie 140049757151280 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "initiated_at": "2024-09-17T23:05:37.957985+0000", 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "age": 0.24491690299999999, 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.0011319279999999999, 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "continuous": false, 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "type_data": { 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "flag_point": "started", 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "client_info": { 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "client": "client.6219", 2024-09-17T23:05:38.297 INFO:teuthology.orchestra.run.smithi005.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "tid": 110 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "events": [ 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "initiated", 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.957985+0000", 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "header_read", 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.957985+0000", 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "throttled", 2024-09-17T23:05:38.298 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.957985+0000", 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 4.2500000000000001e-07 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "all_read", 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.957988+0000", 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 2.4329999999999998e-06 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "dispatched", 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.958004+0000", 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 1.6497000000000001e-05 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.299 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.958010+0000", 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 6.2600000000000002e-06 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "reached_pg", 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.958338+0000", 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00032758400000000001 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "started", 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.958429+0000", 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 9.1398999999999997e-05 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-09-17T23:05:38.300 INFO:teuthology.orchestra.run.smithi005.stdout: "event": "done", 2024-09-17T23:05:38.301 INFO:teuthology.orchestra.run.smithi005.stdout: "time": "2024-09-17T23:05:37.959117+0000", 2024-09-17T23:05:38.301 INFO:teuthology.orchestra.run.smithi005.stdout: "duration": 0.00068732999999999999 2024-09-17T23:05:38.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.301 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-09-17T23:05:38.301 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-09-17T23:05:38.301 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:38.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-17T23:05:38.303 INFO:tasks.ceph.osd.0.smithi005.stderr:2024-09-17T23:05:38.300+0000 7f96c74e7640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 33333) UID: 0 2024-09-17T23:05:38.404 INFO:tasks.ceph.osd.3.smithi005.stderr:2024-09-17T23:05:38.401+0000 7f45adb3b640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 33347) UID: 0 2024-09-17T23:05:38.406 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:38.406 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:38.406 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:38.406 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:38.415 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-17T23:05:38.416 DEBUG:teuthology.parallel:result is None 2024-09-17T23:05:38.416 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T23:05:38.481 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T23:05:38.481 DEBUG:teuthology.orchestra.run.smithi005:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-17T23:05:38.505 INFO:tasks.ceph.osd.4.smithi152.stderr:2024-09-17T23:05:38.502+0000 7fb45b9e8640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 33757) UID: 0 2024-09-17T23:05:38.520 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:38.520 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:38.520 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:38.520 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:38.520 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:38.528 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-17T23:05:38.545 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-17T23:05:38.545 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-17T23:05:38.554 INFO:tasks.thrashosds:joining thrashosds 2024-09-17T23:05:38.674 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:38.674 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 37 entries 103'33 (0'0) error 2:f18b0147:::rbd_data.14d56a47625e.0000000000000012:head by client.5411.0:89 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'29)", 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.850240+0000", 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.8211031120000003, 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0023259270000000002, 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.675 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850240+0000", 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850240+0000", 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850241+0000", 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8500000000000001e-07 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.676 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850248+0000", 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1840000000000002e-06 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850267+0000", 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.933e-05 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850284+0000", 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6308999999999999e-05 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.677 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850381+0000", 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7155000000000001e-05 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.852566+0000", 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002185364 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 40 entries 103'34 (0'0) error 2:f361c684:::rbd_data.14d56a47625e.000000000000001f:head by client.5411.0:102 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'31)", 2024-09-17T23:05:38.678 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.853141+0000", 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.8182020970000004, 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0022741530000000001, 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853141+0000", 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.679 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853141+0000", 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853148+0000", 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0149999999999998e-06 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853157+0000", 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8689999999999993e-06 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.680 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853178+0000", 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0866999999999999e-05 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853192+0000", 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4161999999999999e-05 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853270+0000", 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7778e-05 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.681 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.855416+0000", 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021454619999999999 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 52 entries 103'39 (0'0) error 2:e2e71df8:::rbd_data.132cc2a15bff.0000000000000017:head by client.5883.0:94 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'37)", 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.963994+0000", 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.7073494480000004, 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001015162, 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.682 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963994+0000", 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963994+0000", 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.683 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963995+0000", 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.105e-06 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.964004+0000", 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.346e-06 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.964025+0000", 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0750999999999998e-05 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.684 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.964036+0000", 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0899e-05 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.964099+0000", 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2974999999999999e-05 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965009+0000", 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091008599999999995 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.685 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 53 entries 103'40 (0'0) error 2:f36632b2:::rbd_data.132cc2a15bff.000000000000001f:head by client.5883.0:102 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'38)", 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.968790+0000", 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.702553676, 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021382649999999999, 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968790+0000", 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.686 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968790+0000", 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968791+0000", 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5499999999999997e-07 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968800+0000", 2024-09-17T23:05:38.687 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.1179999999999998e-06 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968821+0000", 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0911e-05 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968835+0000", 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.428e-05 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.688 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968918+0000", 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2960000000000005e-05 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.970928+0000", 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020102409999999999 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5423.0:14 2.7 e103/81 2:f3b0e5b2:::journal.152ffc5dba83:head v 103'44, mlcod=103'42)", 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.657520+0000", 2024-09-17T23:05:38.689 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.0138238079999997, 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001385254, 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.657520+0000", 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.657520+0000", 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.690 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.657520+0000", 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.8999999999999997e-07 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.657525+0000", 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4730000000000002e-06 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.657533+0000", 2024-09-17T23:05:38.691 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4309999999999994e-06 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.657538+0000", 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5449999999999997e-06 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.657580+0000", 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2687e-05 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.657601+0000", 2024-09-17T23:05:38.692 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1098e-05 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.658880+0000", 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0012785509999999999 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.658905+0000", 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4978999999999999e-05 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.693 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 65 entries 103'47 (0'0) error 2:fc66dd19:::rbd_data.152ffc5dba83.0000000000000008:head by client.5459.0:79 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'43)", 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.933123+0000", 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.7382201230000001, 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0027122539999999999, 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933123+0000", 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.694 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933123+0000", 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933124+0000", 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6400000000000003e-07 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933130+0000", 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8150000000000002e-06 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.695 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933142+0000", 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2622999999999999e-05 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933153+0000", 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0566e-05 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933227+0000", 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4488999999999998e-05 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.696 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.935836+0000", 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0026082969999999999 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 67 entries 103'48 (0'0) error 2:fe5571be:::rbd_data.152ffc5dba83.0000000000000009:head by client.5459.0:80 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'43)", 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.933550+0000", 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.7377938240000002, 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0049501570000000002, 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.697 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933550+0000", 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933550+0000", 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933550+0000", 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6100000000000001e-07 2024-09-17T23:05:38.698 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933558+0000", 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.289e-06 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933574+0000", 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6959000000000001e-05 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933588+0000", 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3447e-05 2024-09-17T23:05:38.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933660+0000", 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2027999999999995e-05 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.938500+0000", 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048398729999999997 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.700 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 68 entries 103'49 (0'0) error 2:f11c28e6:::rbd_data.152ffc5dba83.000000000000000d:head by client.5459.0:84 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'44)", 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.933961+0000", 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.737382089, 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0045643400000000001, 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933961+0000", 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.701 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933961+0000", 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933962+0000", 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2200000000000004e-07 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933968+0000", 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0079999999999999e-06 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.702 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933981+0000", 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3078000000000001e-05 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933989+0000", 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5490000000000001e-06 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934039+0000", 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0494000000000001e-05 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.703 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.938526+0000", 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0044866890000000003 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 69 entries 103'50 (0'0) error 2:e0a78bb2:::rbd_data.152ffc5dba83.0000000000000011:head by client.5459.0:89 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'44)", 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.934801+0000", 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.7365426180000001, 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0037445989999999999, 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.704 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934801+0000", 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934801+0000", 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934802+0000", 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3900000000000004e-07 2024-09-17T23:05:38.705 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934811+0000", 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0720000000000006e-06 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934827+0000", 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6008999999999999e-05 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934852+0000", 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5607999999999999e-05 2024-09-17T23:05:38.706 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934934+0000", 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1791000000000003e-05 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.938545+0000", 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0036114799999999998 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 74 entries 103'51 (0'0) error 2:f8b9afa1:::rbd_data.152ffc5dba83.000000000000002e:head by client.5459.0:118 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'49)", 2024-09-17T23:05:38.707 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.944350+0000", 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.7269930019999999, 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0021523649999999998, 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944350+0000", 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944350+0000", 2024-09-17T23:05:38.708 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944352+0000", 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2190000000000001e-06 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944360+0000", 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8900000000000007e-06 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.709 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944381+0000", 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1118999999999999e-05 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944396+0000", 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5136999999999999e-05 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944481+0000", 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4954e-05 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.710 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946503+0000", 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002022046 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 76 entries 103'52 (0'0) error 2:f548ff9c:::rbd_data.152ffc5dba83.000000000000003e:head by client.5459.0:134 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'50)", 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.948746+0000", 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.7225975689999999, 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029987830000000001, 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.711 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948746+0000", 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948746+0000", 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948747+0000", 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6199999999999997e-07 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.712 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948753+0000", 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1369999999999999e-06 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948768+0000", 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5353e-05 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948777+0000", 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.4989999999999994e-06 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.713 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948828+0000", 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1146000000000001e-05 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.951745+0000", 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029169859999999999 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 79 entries 103'55 (0'0) error 2:fa061102:::journal_data.2.152ffc5dba83.2:head by client.5459.0:151 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'53)", 2024-09-17T23:05:38.714 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.962590+0000", 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.7087536879999998, 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018517539999999999, 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962590+0000", 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.715 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962590+0000", 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962592+0000", 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8920000000000001e-06 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962599+0000", 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.289e-06 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.716 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962617+0000", 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8510000000000001e-05 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962631+0000", 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3682e-05 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962712+0000", 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1039999999999997e-05 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.717 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.964442+0000", 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0017293409999999999 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 103/81 rep_tid 80 entries 103'56 (0'0) error 2:f3b0e5b2:::journal.152ffc5dba83:head by client.5459.0:155 0.000000 -22 [r=-22+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'54)", 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.965219+0000", 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.7061240959999999, 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018435159999999999, 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.718 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965219+0000", 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965219+0000", 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965220+0000", 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9500000000000002e-07 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.719 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965226+0000", 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1739999999999997e-06 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965241+0000", 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5285999999999999e-05 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965254+0000", 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2697000000000001e-05 2024-09-17T23:05:38.720 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965318+0000", 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4126000000000002e-05 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.967063+0000", 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001744638 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.721 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5459.0:156 2.7 e103/81 2:f3b0e5b2:::journal.152ffc5dba83:head v 103'57, mlcod=103'54)", 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.965442+0000", 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 3.705901028, 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.004351761, 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965442+0000", 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.722 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965442+0000", 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965443+0000", 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2600000000000002e-07 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965450+0000", 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.058e-06 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.723 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965462+0000", 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1966e-05 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965470+0000", 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2349999999999999e-06 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965511+0000", 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0228999999999997e-05 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.724 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965524+0000", 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3314e-05 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.969757+0000", 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0042334299999999998 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.969794+0000", 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6803e-05 2024-09-17T23:05:38.725 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 105/81 rep_tid 195 entries 105'132 (0'0) error 2:fb2ad0a1:::rbd_data.17e8eb94ce63.0000000000000037:head by client.6162.0:127 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'126)", 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.555740+0000", 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.1156037139999999, 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001637318, 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.555740+0000", 2024-09-17T23:05:38.726 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.555740+0000", 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.555740+0000", 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8899999999999999e-07 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.555747+0000", 2024-09-17T23:05:38.727 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7719999999999997e-06 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.555762+0000", 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4990999999999999e-05 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.555771+0000", 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0929999999999992e-06 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.728 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.555821+0000", 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9796999999999998e-05 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.557377+0000", 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001556076 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 105/81 rep_tid 199 entries 105'133 (0'0) error 2:fa988718:::journal_data.2.17e8eb94ce63.1:head by client.6162.0:150 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'131)", 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.572027+0000", 2024-09-17T23:05:38.729 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.0993169380000001, 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002927621, 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572027+0000", 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572027+0000", 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.730 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572027+0000", 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3200000000000005e-07 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572034+0000", 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3640000000000004e-06 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572050+0000", 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6212999999999999e-05 2024-09-17T23:05:38.731 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572063+0000", 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3156000000000001e-05 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572134+0000", 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1233000000000001e-05 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.574954+0000", 2024-09-17T23:05:38.732 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028200230000000001 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 105/81 rep_tid 200 entries 105'134 (0'0) error 2:fd649a66:::journal_data.2.17e8eb94ce63.3:head by client.6162.0:152 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'131)", 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.572490+0000", 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.0988536689999999, 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0027122349999999999, 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.733 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572490+0000", 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572490+0000", 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572491+0000", 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9500000000000002e-07 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.734 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572498+0000", 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8099999999999998e-06 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572520+0000", 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.1503999999999999e-05 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572536+0000", 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6217000000000001e-05 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.735 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.572603+0000", 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6761999999999995e-05 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.575202+0000", 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0025992469999999998 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 105/81 rep_tid 202 entries 105'135 (0'0) error 2:e9b099c5:::rbd_data.181b6e819781.000000000000000b:head by client.6219.0:82 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'133)", 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.949392+0000", 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.72195152299999998, 2024-09-17T23:05:38.736 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020734740000000001, 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.949392+0000", 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.949392+0000", 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.949393+0000", 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9899999999999999e-07 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.949403+0000", 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0166000000000001e-05 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.949419+0000", 2024-09-17T23:05:38.738 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5984000000000001e-05 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.949428+0000", 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2259999999999994e-06 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.949508+0000", 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0223999999999996e-05 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.739 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951465+0000", 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0019569750000000001 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 105/81 rep_tid 210 entries 105'137 (0'0) error 2:fb7657b8:::rbd_data.181b6e819781.0000000000000019:head by client.6219.0:96 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'134)", 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.953879+0000", 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.71746408800000006, 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.003056993, 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.740 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953879+0000", 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953879+0000", 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.741 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953880+0000", 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.44e-07 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953888+0000", 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7510000000000008e-06 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953903+0000", 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5401999999999999e-05 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.742 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953912+0000", 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7579999999999998e-06 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953971+0000", 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9348999999999997e-05 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.956936+0000", 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029650890000000002 2024-09-17T23:05:38.743 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.7 epoch 105/81 rep_tid 211 entries 105'138 (0'0) error 2:f8b7899d:::rbd_data.181b6e819781.000000000000001a:head by client.6219.0:97 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'134)", 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.954344+0000", 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 0.71699976700000001, 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0051161499999999999, 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:38.744 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954344+0000", 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954344+0000", 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954344+0000", 2024-09-17T23:05:38.745 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7800000000000001e-07 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954352+0000", 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.824e-06 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954371+0000", 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9279e-05 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954391+0000", 2024-09-17T23:05:38.746 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9279999999999998e-05 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954451+0000", 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0649999999999997e-05 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959460+0000", 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050085390000000002 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.747 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:38.748 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:38.748 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:38.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-17T23:05:38.764 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is set 2024-09-17T23:05:38.853 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:38.853 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:38.853 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:38.853 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:38.861 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-17T23:05:38.965 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:38.965 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:38.965 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:38.965 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:38.965 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:38.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-17T23:05:39.078 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4290.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 192.83916695400001, 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059364250000000004, 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.079 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4290", 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/14636601", 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 1 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236446+0000", 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.080 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236451+0000", 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4259999999999996e-06 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236457+0000", 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8220000000000003e-06 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236473+0000", 2024-09-17T23:05:39.081 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5948999999999999e-05 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236486+0000", 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3183000000000001e-05 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236568+0000", 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2588000000000003e-05 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.236579+0000", 2024-09-17T23:05:39.082 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0942e-05 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238416+0000", 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018363780000000001 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238611+0000", 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00019511999999999999 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 2", 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.238776+0000", 2024-09-17T23:05:39.083 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00016500799999999999 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.240309+0000", 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001533293 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242318+0000", 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0020091599999999999 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.084 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242353+0000", 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4900000000000001e-05 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:02:26.242383+0000", 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9655999999999999e-05 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:29 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch ping cookie 139790582302912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:39.085 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.87546335899999, 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353574600000001, 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 29 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.086 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200150+0000", 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200151+0000", 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7100000000000001e-07 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200155+0000", 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5009999999999998e-06 2024-09-17T23:05:39.087 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200161+0000", 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0689999999999998e-06 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200168+0000", 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.613e-06 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200299+0000", 2024-09-17T23:05:39.088 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013120499999999999 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200312+0000", 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2818e-05 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423456+0000", 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22314401 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.089 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423612+0000", 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00015618199999999999 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423686+0000", 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3677000000000006e-05 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.4941.0:30 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [watch reconnect cookie 139790582302912 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:39.090 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 115.875336545, 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.224293615, 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.4941", 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/778549171", 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 30 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.091 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200277+0000", 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4000000000000002e-07 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.092 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200280+0000", 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4200000000000001e-06 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200291+0000", 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.08e-05 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200295+0000", 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6369999999999998e-06 2024-09-17T23:05:39.093 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200341+0000", 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6270000000000003e-05 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for peered", 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.200349+0000", 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1269999999999997e-06 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423879+0000", 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.22353014500000001 2024-09-17T23:05:39.094 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.423940+0000", 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1011999999999998e-05 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:03:43.424570+0000", 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00063076400000000002 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.095 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:89 2.2 2:5579f494:::rbd_data.132cc2a15bff.0000000000000012:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.962960+0000", 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.1126536720000004, 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0054202979999999996, 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 89 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.096 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962960+0000", 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962960+0000", 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962960+0000", 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4399999999999999e-07 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.097 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962969+0000", 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8340000000000005e-06 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962980+0000", 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0468999999999999e-05 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962986+0000", 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9750000000000004e-06 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.098 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963033+0000", 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6734999999999999e-05 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963113+0000", 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0928999999999997e-05 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968380+0000", 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0052666120000000004 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.099 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:90 2.2 2:55dd888b:::rbd_data.132cc2a15bff.0000000000000013:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.963002+0000", 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.1126109529999999, 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.005452007, 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 90 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.100 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963002+0000", 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963002+0000", 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963003+0000", 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9200000000000002e-07 2024-09-17T23:05:39.101 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963005+0000", 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.03e-06 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963009+0000", 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5299999999999998e-06 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963013+0000", 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1990000000000002e-06 2024-09-17T23:05:39.102 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963276+0000", 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00026377099999999999 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963344+0000", 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7626000000000006e-05 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968454+0000", 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0051104590000000004 2024-09-17T23:05:39.103 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:92 2.3 2:d86b2cc1:::rbd_data.132cc2a15bff.0000000000000015:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.963299+0000", 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.1123149039999998, 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050338379999999997, 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.104 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 92 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963299+0000", 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963299+0000", 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.105 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963299+0000", 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7000000000000005e-07 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963302+0000", 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5890000000000001e-06 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963306+0000", 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7809999999999996e-06 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.106 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963311+0000", 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.758e-06 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963354+0000", 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3003999999999997e-05 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963472+0000", 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000117945 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.107 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968332+0000", 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048601909999999998 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:93 2.2 2:4f11e731:::rbd_data.132cc2a15bff.0000000000000016:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.963372+0000", 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.1122417929999999, 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0051477830000000004, 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.108 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 93 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963372+0000", 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963372+0000", 2024-09-17T23:05:39.109 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963372+0000", 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2899999999999999e-07 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963374+0000", 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9580000000000001e-06 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.110 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963379+0000", 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5240000000000002e-06 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963382+0000", 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1669999999999999e-06 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963490+0000", 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000107899 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963555+0000", 2024-09-17T23:05:39.111 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5392e-05 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968519+0000", 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0049644140000000003 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:97 2.3 2:d90e5a24:::rbd_data.132cc2a15bff.000000000000001a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.965717+0000", 2024-09-17T23:05:39.112 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.1098964159999998, 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0049702399999999999, 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 97 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965717+0000", 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.113 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965717+0000", 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965718+0000", 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7899999999999998e-07 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965721+0000", 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3749999999999999e-06 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.114 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965731+0000", 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.8959999999999998e-06 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965738+0000", 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9489999999999999e-06 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965777+0000", 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9354000000000003e-05 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.115 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965859+0000", 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.1960999999999997e-05 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.970687+0000", 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.004828026 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:109 2.3 2:d000243d:::rbd_header.132cc2a15bff:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.572027+0000", 2024-09-17T23:05:39.116 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.503586522, 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.005050868, 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 109 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.572027+0000", 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.572027+0000", 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.572028+0000", 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6000000000000003e-07 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.572031+0000", 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5640000000000001e-06 2024-09-17T23:05:39.118 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.572040+0000", 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5339999999999999e-06 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.572045+0000", 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.485e-06 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.572082+0000", 2024-09-17T23:05:39.119 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6303999999999997e-05 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.572126+0000", 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.4255000000000002e-05 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.577078+0000", 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0049519660000000004 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.120 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:105 2.2 2:493d0f6b:::rbd_data.152ffc5dba83.0000000000000021:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.939007+0000", 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.136606381, 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048887840000000002, 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 105 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.121 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939007+0000", 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939007+0000", 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939008+0000", 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7400000000000003e-07 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.122 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939011+0000", 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.3160000000000001e-06 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939017+0000", 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.5659999999999997e-06 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939020+0000", 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6600000000000001e-06 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.123 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939056+0000", 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6133000000000001e-05 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939124+0000", 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8004999999999997e-05 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943896+0000", 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0047715300000000004 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.124 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:115 2.3 2:dccee36e:::rbd_data.152ffc5dba83.000000000000002b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.941370+0000", 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.1342434179999996, 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0052034459999999996, 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 115 2024-09-17T23:05:39.125 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941370+0000", 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941370+0000", 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941371+0000", 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6499999999999999e-07 2024-09-17T23:05:39.126 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941374+0000", 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6629999999999999e-06 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941384+0000", 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9359999999999994e-06 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941389+0000", 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1919999999999996e-06 2024-09-17T23:05:39.127 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941430+0000", 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0160999999999997e-05 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941508+0000", 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8776999999999995e-05 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946573+0000", 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050650519999999996 2024-09-17T23:05:39.128 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:123 2.3 2:c87411e1:::rbd_data.152ffc5dba83.0000000000000033:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.944392+0000", 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.1312210819999997, 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048441810000000004, 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.129 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 123 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944392+0000", 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944392+0000", 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.130 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944393+0000", 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7999999999999995e-07 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944396+0000", 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1590000000000002e-06 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944405+0000", 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2150000000000007e-06 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.131 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944412+0000", 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4799999999999998e-06 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944787+0000", 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000375113 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944919+0000", 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013193699999999999 2024-09-17T23:05:39.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.949237+0000", 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043176969999999997 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:127 2.2 2:47c4e65c:::rbd_data.152ffc5dba83.0000000000000037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.946582+0000", 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.129031736, 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0079522499999999992, 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.133 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 127 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946582+0000", 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.134 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946582+0000", 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946583+0000", 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4300000000000001e-07 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946588+0000", 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.2360000000000004e-06 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.135 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946600+0000", 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1972e-05 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946607+0000", 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6149999999999999e-06 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946649+0000", 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1573999999999999e-05 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.136 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946720+0000", 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1135000000000002e-05 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.954534+0000", 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0078137750000000002 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:130 2.3 2:cbfcd5d3:::rbd_data.152ffc5dba83.000000000000003a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.946913+0000", 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.12870034, 2024-09-17T23:05:39.137 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076191560000000002, 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 130 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946913+0000", 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.138 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946913+0000", 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946914+0000", 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8700000000000005e-07 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946917+0000", 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5559999999999999e-06 2024-09-17T23:05:39.139 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946928+0000", 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0981e-05 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946935+0000", 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3219999999999998e-06 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946977+0000", 2024-09-17T23:05:39.140 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2382999999999997e-05 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947056+0000", 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9154999999999997e-05 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.954532+0000", 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0074760720000000003 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.141 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:131 2.2 2:4fb0630b:::rbd_data.152ffc5dba83.000000000000003b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.946985+0000", 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.1286287870000002, 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0076142839999999998, 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 131 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.142 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946985+0000", 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946985+0000", 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.143 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946985+0000", 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.0200000000000001e-07 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946989+0000", 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.377e-06 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946998+0000", 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6320000000000003e-06 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.144 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947005+0000", 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3960000000000003e-06 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947039+0000", 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.4499999999999998e-05 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947112+0000", 2024-09-17T23:05:39.145 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2725000000000006e-05 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.954599+0000", 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0074868519999999996 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:100 2.3 2:d64eaab1:::rbd_data.181b6e819781.000000000000001d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.954526+0000", 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.1210875709999999, 2024-09-17T23:05:39.146 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0049968349999999998, 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 100 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954526+0000", 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.147 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954526+0000", 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954526+0000", 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0299999999999999e-07 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954529+0000", 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.7310000000000002e-06 2024-09-17T23:05:39.148 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954537+0000", 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6939999999999995e-06 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954542+0000", 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4779999999999999e-06 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954831+0000", 2024-09-17T23:05:39.149 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00028897599999999998 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954981+0000", 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00014981700000000001 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959523+0000", 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0045416359999999999 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.150 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:105 2.3 2:cca03065:::rbd_data.181b6e819781.0000000000000022:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.957156+0000", 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.118457893, 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0051350079999999999, 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 105 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.151 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957156+0000", 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957156+0000", 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957156+0000", 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4099999999999998e-07 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.152 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957160+0000", 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.912e-06 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957170+0000", 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0006999999999999e-05 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957175+0000", 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1660000000000002e-06 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.153 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957219+0000", 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3733000000000003e-05 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957311+0000", 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.1541999999999999e-05 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.962291+0000", 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0049799070000000004 2024-09-17T23:05:39.154 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:107 2.2 2:406484a0:::rbd_data.181b6e819781.0000000000000024:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.957245+0000", 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.118368231, 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050480860000000002, 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.155 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 107 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957245+0000", 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957245+0000", 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.156 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957246+0000", 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4e-07 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957250+0000", 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.092e-06 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957261+0000", 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0514e-05 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.157 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957267+0000", 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8170000000000004e-06 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957317+0000", 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0018000000000001e-05 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957436+0000", 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000119047 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.158 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.962293+0000", 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048576579999999999 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:115 2.3 2:c170ec01:::rbd_data.181b6e819781.000000000000002b:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.959611+0000", 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.1160023889999999, 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056700489999999999, 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.159 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 115 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959611+0000", 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959611+0000", 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.160 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959612+0000", 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7199999999999998e-07 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959623+0000", 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1105e-05 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959635+0000", 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2043e-05 2024-09-17T23:05:39.161 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959650+0000", 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5432000000000001e-05 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959691+0000", 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0672e-05 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959781+0000", 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0210000000000005e-05 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.162 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.965281+0000", 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0054999150000000002 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:116 2.3 2:ca1e8df7:::rbd_data.181b6e819781.000000000000002c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.959691+0000", 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.1159223759999999, 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0056746330000000001, 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.163 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 116 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959691+0000", 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959691+0000", 2024-09-17T23:05:39.164 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959692+0000", 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9100000000000004e-07 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959694+0000", 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.667e-06 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.165 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959700+0000", 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.463e-06 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959703+0000", 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5889999999999999e-06 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959964+0000", 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00026049100000000001 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.166 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.960043+0000", 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9122999999999994e-05 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.965366+0000", 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053228090000000004 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.167 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:39.168 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-17T23:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:39.274 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:39.282 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-17T23:05:39.385 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:39.385 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:39.386 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:39.386 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:39.386 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:39.394 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-17T23:05:39.498 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:39.498 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5411.0:89 2.7 2:f18b0147:::rbd_data.14d56a47625e.0000000000000012:head [delete] snapc 3=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.849777+0000", 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.6458004800000001, 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0035096279999999999, 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5411", 2024-09-17T23:05:39.499 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3645110916", 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 89 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849777+0000", 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849777+0000", 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.500 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849778+0000", 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.9999999999999995e-07 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849783+0000", 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9980000000000003e-06 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849795+0000", 2024-09-17T23:05:39.501 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2123000000000001e-05 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849803+0000", 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8129999999999996e-06 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.849941+0000", 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00013792500000000001 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.850056+0000", 2024-09-17T23:05:39.502 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000114913 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.853286+0000", 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0032308559999999998 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:94 2.7 2:e2e71df8:::rbd_data.132cc2a15bff.0000000000000017:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.963563+0000", 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.5320139150000003, 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048274010000000003, 2024-09-17T23:05:39.503 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 94 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963563+0000", 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.504 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963563+0000", 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963564+0000", 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3e-07 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963568+0000", 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.8430000000000003e-06 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.505 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963578+0000", 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0606e-05 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963584+0000", 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.147e-06 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963637+0000", 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3832999999999998e-05 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.506 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.963763+0000", 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012576300000000001 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968391+0000", 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0046274790000000003 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:99 2.6 2:7b83e111:::rbd_data.132cc2a15bff.000000000000001c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.507 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.968457+0000", 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.5271203340000001, 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0054337489999999999, 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 99 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968457+0000", 2024-09-17T23:05:39.508 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968457+0000", 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968458+0000", 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7000000000000004e-07 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968462+0000", 2024-09-17T23:05:39.509 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0069999999999999e-06 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968472+0000", 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0253e-05 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968477+0000", 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3600000000000004e-06 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968526+0000", 2024-09-17T23:05:39.510 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9156999999999997e-05 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968640+0000", 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000113569 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.973891+0000", 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0052507329999999996 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.511 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5883.0:102 2.7 2:f36632b2:::rbd_data.132cc2a15bff.000000000000001f:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.968524+0000", 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.5270533410000002, 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0047463569999999997, 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5883", 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/2988876083", 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 102 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.512 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.513 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.513 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968524+0000", 2024-09-17T23:05:39.513 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.513 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.513 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.514 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968524+0000", 2024-09-17T23:05:39.514 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.514 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.514 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.514 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968525+0000", 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.0399999999999995e-07 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968528+0000", 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1860000000000001e-06 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.515 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968533+0000", 2024-09-17T23:05:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3639999999999998e-06 2024-09-17T23:05:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968537+0000", 2024-09-17T23:05:39.516 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7919999999999999e-06 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968577+0000", 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0496e-05 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.517 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968651+0000", 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3572999999999995e-05 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.973270+0000", 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.004619242 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.518 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.519 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.519 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.519 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:79 2.7 2:fc66dd19:::rbd_data.152ffc5dba83.0000000000000008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.519 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.931902+0000", 2024-09-17T23:05:39.519 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5636752559999998, 2024-09-17T23:05:39.519 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0057194999999999998, 2024-09-17T23:05:39.519 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.519 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.520 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.520 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.520 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.520 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.520 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 79 2024-09-17T23:05:39.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.521 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.521 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.521 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.521 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931902+0000", 2024-09-17T23:05:39.521 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.521 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931902+0000", 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931902+0000", 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9999999999999998e-07 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.522 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931905+0000", 2024-09-17T23:05:39.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4949999999999998e-06 2024-09-17T23:05:39.523 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.523 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.523 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.523 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931912+0000", 2024-09-17T23:05:39.523 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.7830000000000001e-06 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931916+0000", 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7790000000000003e-06 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932831+0000", 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00091419600000000004 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.524 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932939+0000", 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00010876500000000001 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.937621+0000", 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0046820819999999997 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:80 2.7 2:fe5571be:::rbd_data.152ffc5dba83.0000000000000009:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.931923+0000", 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5636541680000002, 2024-09-17T23:05:39.525 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0068258950000000002, 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 80 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931923+0000", 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931923+0000", 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931923+0000", 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.7300000000000002e-07 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931926+0000", 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.295e-06 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.527 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931932+0000", 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9909999999999999e-06 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.931936+0000", 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5639999999999998e-06 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933246+0000", 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001310035 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.528 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933362+0000", 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000115455 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.938749+0000", 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053871819999999999 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:83 2.6 2:7982f39b:::rbd_data.152ffc5dba83.000000000000000c:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.932787+0000", 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5627897480000001, 2024-09-17T23:05:39.529 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048439110000000002, 2024-09-17T23:05:39.530 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.530 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.530 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.530 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.530 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.530 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.530 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 83 2024-09-17T23:05:39.530 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932787+0000", 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932787+0000", 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.531 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932789+0000", 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0330000000000001e-06 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932793+0000", 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.729e-06 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932817+0000", 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.3419999999999999e-05 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.532 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932824+0000", 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.5279999999999998e-06 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932874+0000", 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9657999999999998e-05 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932975+0000", 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00010110100000000001 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.533 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.937631+0000", 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0046564420000000002 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:84 2.7 2:f11c28e6:::rbd_data.152ffc5dba83.000000000000000d:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.932902+0000", 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5626754080000005, 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0059831889999999999, 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.534 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 84 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932902+0000", 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932902+0000", 2024-09-17T23:05:39.535 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932903+0000", 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8100000000000001e-07 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932907+0000", 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0219999999999998e-06 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932916+0000", 2024-09-17T23:05:39.536 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5859999999999994e-06 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.932926+0000", 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.5710000000000004e-06 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933754+0000", 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00082844899999999998 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.537 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933824+0000", 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9843000000000002e-05 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.938885+0000", 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0050608370000000003 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:89 2.7 2:e0a78bb2:::rbd_data.152ffc5dba83.0000000000000011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.934516+0000", 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5610610439999997, 2024-09-17T23:05:39.538 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0045413160000000001, 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 89 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934516+0000", 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.539 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934516+0000", 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934517+0000", 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8400000000000004e-07 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934520+0000", 2024-09-17T23:05:39.540 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.1379999999999999e-06 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934529+0000", 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9619999999999999e-06 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934535+0000", 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5989999999999998e-06 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.541 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934575+0000", 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.9830000000000003e-05 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934649+0000", 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3438999999999999e-05 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939058+0000", 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0044087639999999999 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.542 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:107 2.6 2:7b3c6834:::rbd_data.152ffc5dba83.0000000000000023:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.939830+0000", 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5557474070000001, 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0041293509999999999, 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 107 2024-09-17T23:05:39.543 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939830+0000", 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939830+0000", 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.544 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939830+0000", 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.4299999999999999e-07 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939832+0000", 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.875e-06 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939837+0000", 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7219999999999999e-06 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.545 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.939840+0000", 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.163e-06 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940118+0000", 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000278232 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940208+0000", 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9697999999999994e-05 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.546 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943959+0000", 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0037514179999999999 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:113 2.6 2:632fcd4b:::rbd_data.152ffc5dba83.0000000000000029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.940284+0000", 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5552929219999996, 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0037861309999999999, 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.547 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 113 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940284+0000", 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940284+0000", 2024-09-17T23:05:39.548 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940285+0000", 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.3099999999999998e-07 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940288+0000", 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8700000000000001e-06 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.549 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940294+0000", 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4489999999999996e-06 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940303+0000", 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8400000000000001e-06 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940359+0000", 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6041000000000001e-05 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940436+0000", 2024-09-17T23:05:39.550 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7415000000000003e-05 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944070+0000", 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0036339850000000002 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:125 2.6 2:6e62d433:::rbd_data.152ffc5dba83.0000000000000035:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.945142+0000", 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5504349179999997, 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.004020671, 2024-09-17T23:05:39.551 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 125 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.945142+0000", 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.552 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.945142+0000", 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.945143+0000", 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1500000000000004e-07 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.945146+0000", 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9450000000000002e-06 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.553 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.945155+0000", 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9779999999999994e-06 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.945160+0000", 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7709999999999997e-06 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.945195+0000", 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.5818999999999997e-05 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.554 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.945265+0000", 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.9111999999999998e-05 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.949163+0000", 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038984309999999999 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:134 2.7 2:f548ff9c:::rbd_data.152ffc5dba83.000000000000003e:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.948047+0000", 2024-09-17T23:05:39.555 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5475302720000004, 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0038994049999999999, 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 134 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948047+0000", 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948047+0000", 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948049+0000", 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9099999999999999e-06 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.557 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948068+0000", 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9466e-05 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948095+0000", 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.6446999999999999e-05 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948108+0000", 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3613e-05 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.558 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948228+0000", 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000119825 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948540+0000", 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00031164000000000002 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.951946+0000", 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0034065039999999999 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.559 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.5459.0:156 2.7 2:f3b0e5b2:::journal.152ffc5dba83:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e103)", 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.964983+0000", 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.5305937610000004, 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0049779100000000003, 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.5459", 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/3360718145", 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 156 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.560 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.964983+0000", 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.964983+0000", 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.964984+0000", 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.8500000000000002e-07 2024-09-17T23:05:39.561 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.964985+0000", 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.624e-06 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.964990+0000", 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.95e-06 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.964993+0000", 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.061e-06 2024-09-17T23:05:39.562 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965272+0000", 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00027876700000000002 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965317+0000", 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5133000000000003e-05 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "waiting for subops from 4", 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.965386+0000", 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8421000000000001e-05 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.563 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "op_commit", 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.969770+0000", 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043843909999999996 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "sub_op_commit_rec", 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.969881+0000", 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000111288 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.969911+0000", 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.9629e-05 2024-09-17T23:05:39.564 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.969961+0000", 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0361000000000001e-05 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:87 2.6 2:6f88978b:::rbd_data.181b6e819781.0000000000000010:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.951779+0000", 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.5437978050000001, 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0051763750000000004, 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.565 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 87 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951779+0000", 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951779+0000", 2024-09-17T23:05:39.566 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951780+0000", 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7100000000000002e-07 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951783+0000", 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5969999999999999e-06 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951790+0000", 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8970000000000008e-06 2024-09-17T23:05:39.567 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951796+0000", 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7760000000000003e-06 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952309+0000", 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000513172 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952384+0000", 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4077000000000002e-05 2024-09-17T23:05:39.568 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.956956+0000", 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0045722849999999997 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:93 2.6 2:61860beb:::rbd_data.181b6e819781.0000000000000016:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.952632+0000", 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.5429452189999999, 2024-09-17T23:05:39.569 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.004429812, 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 93 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952632+0000", 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.570 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952632+0000", 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952633+0000", 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.6099999999999999e-07 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952637+0000", 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6290000000000001e-06 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.571 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952650+0000", 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2404e-05 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952659+0000", 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.8990000000000007e-06 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952706+0000", 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6819e-05 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.572 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.952800+0000", 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4537000000000006e-05 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957062+0000", 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0042616629999999997 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:94 2.7 2:e8129e14:::rbd_data.181b6e819781.0000000000000017:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.573 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.953136+0000", 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.542440955, 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.003862304, 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 94 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.574 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953136+0000", 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953136+0000", 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.575 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953137+0000", 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0500000000000002e-07 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953144+0000", 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6220000000000003e-06 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953157+0000", 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3597999999999999e-05 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.576 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953176+0000", 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8850000000000001e-05 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953234+0000", 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7503999999999997e-05 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953367+0000", 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000133134 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.577 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.956999+0000", 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0036316909999999998 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:96 2.7 2:fb7657b8:::rbd_data.181b6e819781.0000000000000019:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.953459+0000", 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.542118063, 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.003654521, 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.578 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 96 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953459+0000", 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953459+0000", 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.579 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953460+0000", 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.78e-07 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953465+0000", 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9989999999999999e-06 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953476+0000", 2024-09-17T23:05:39.580 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0379e-05 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953484+0000", 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5909999999999996e-06 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953650+0000", 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000166019 2024-09-17T23:05:39.581 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953730+0000", 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9913000000000006e-05 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.957114+0000", 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033836420000000001 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.582 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:97 2.7 2:f8b7899d:::rbd_data.181b6e819781.000000000000001a:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.953498+0000", 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.542079607, 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0061340700000000001, 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 97 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.583 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953498+0000", 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953498+0000", 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953498+0000", 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.3300000000000003e-07 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.584 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953501+0000", 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.633e-06 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953508+0000", 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8449999999999997e-06 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953513+0000", 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1719999999999998e-06 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.585 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953952+0000", 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00043973200000000002 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954078+0000", 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00012575800000000001 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959632+0000", 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0055534970000000001 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.586 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_op(client.6219.0:102 2.6 2:67018dce:::rbd_data.181b6e819781.000000000000001f:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e105)", 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.954680+0000", 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.540897644, 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048729419999999999, 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "started", 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "client_info": { 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "client": "client.6219", 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "client_addr": "172.21.15.5:0/4159906226", 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: "tid": 102 2024-09-17T23:05:39.587 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954680+0000", 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954680+0000", 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954680+0000", 2024-09-17T23:05:39.588 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2099999999999995e-07 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954685+0000", 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.284e-06 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954697+0000", 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2223e-05 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.589 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954704+0000", 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3599999999999998e-06 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954746+0000", 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.1560000000000002e-05 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.954839+0000", 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.2683999999999996e-05 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.590 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959553+0000", 2024-09-17T23:05:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0047140100000000002 2024-09-17T23:05:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.591 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.591 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:39.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-17T23:05:39.695 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:39.695 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:39.695 INFO:teuthology.orchestra.run.smithi152.stdout: "num_ops": 0 2024-09-17T23:05:39.696 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:39.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-17T23:05:39.807 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:39.807 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [], 2024-09-17T23:05:39.807 INFO:teuthology.orchestra.run.smithi152.stdout: "complaint_time": 30, 2024-09-17T23:05:39.808 INFO:teuthology.orchestra.run.smithi152.stdout: "num_blocked_ops": 0 2024-09-17T23:05:39.808 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:39.816 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-17T23:05:39.920 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-09-17T23:05:39.920 INFO:teuthology.orchestra.run.smithi152.stdout: "size": 20, 2024-09-17T23:05:39.920 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 600, 2024-09-17T23:05:39.921 INFO:teuthology.orchestra.run.smithi152.stdout: "ops": [ 2024-09-17T23:05:39.921 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.921 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "osd_repop(client.5411.0:121 2.0 e103/100 2:167788c7:::journal.14d56a47625e:head v 103'31, mlcod=103'28)", 2024-09-17T23:05:39.924 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.865702+0000", 2024-09-17T23:05:39.924 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 6.051945774, 2024-09-17T23:05:39.924 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0037829550000000002, 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865702+0000", 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.925 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865702+0000", 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865703+0000", 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4000000000000002e-07 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865708+0000", 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5120000000000002e-06 2024-09-17T23:05:39.926 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865718+0000", 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0000000000000001e-05 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865721+0000", 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.6559999999999998e-06 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865762+0000", 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.0995000000000003e-05 2024-09-17T23:05:39.927 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "started", 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.865783+0000", 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0835999999999998e-05 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "commit_sent", 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.869455+0000", 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0036722109999999999 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.928 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.869485+0000", 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 3.0205e-05 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 67 entries 103'33 (0'0) error 2:068c927a:::rbd_data.132cc2a15bff.000000000000000c:head by client.5883.0:83 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'30)", 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.962670+0000", 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.9549782310000001, 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002474675, 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.929 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962670+0000", 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962670+0000", 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962671+0000", 2024-09-17T23:05:39.930 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6499999999999999e-07 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962677+0000", 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6329999999999999e-06 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962692+0000", 2024-09-17T23:05:39.931 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5242000000000001e-05 2024-09-17T23:05:39.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.932 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.932 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.932 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962702+0000", 2024-09-17T23:05:39.932 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.1379999999999996e-06 2024-09-17T23:05:39.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.932 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.932 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.962761+0000", 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9585e-05 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965145+0000", 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002383512 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 71 entries 103'34 (0'0) error 2:040098b5:::rbd_data.132cc2a15bff.0000000000000019:head by client.5883.0:96 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'32)", 2024-09-17T23:05:39.933 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:33.965877+0000", 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.9517709940000003, 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0022731159999999999, 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965877+0000", 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965877+0000", 2024-09-17T23:05:39.934 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965878+0000", 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.6699999999999999e-07 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965888+0000", 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.0103e-05 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.935 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965902+0000", 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4351e-05 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965911+0000", 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3370000000000006e-06 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.965984+0000", 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2508000000000004e-05 2024-09-17T23:05:39.936 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:33.968150+0000", 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00216635 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 73 entries 103'35 (0'0) error 2:1ca8da49:::journal_data.2.132cc2a15bff.1:head by client.5883.0:117 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'33)", 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.581799+0000", 2024-09-17T23:05:39.937 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 5.3358490290000002, 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001928691, 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.581799+0000", 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.938 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.581799+0000", 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.581800+0000", 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4600000000000003e-07 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.581809+0000", 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5900000000000008e-06 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.939 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.581827+0000", 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7875000000000001e-05 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.581836+0000", 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7319999999999993e-06 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.581924+0000", 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7214999999999998e-05 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.940 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.583728+0000", 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001804333 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 91 entries 103'37 (0'0) error 2:05735b28:::rbd_data.152ffc5dba83.000000000000000e:head by client.5459.0:85 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'35)", 2024-09-17T23:05:39.941 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.933318+0000", 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9843298740000002, 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.00243516, 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933318+0000", 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.942 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933318+0000", 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933319+0000", 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3399999999999999e-07 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933326+0000", 2024-09-17T23:05:39.943 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5320000000000003e-06 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933342+0000", 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.6021000000000001e-05 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933350+0000", 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5229999999999995e-06 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.944 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.933423+0000", 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3399999999999995e-05 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.935754+0000", 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0023300500000000002 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 94 entries 103'38 (0'0) error 2:0ac9897f:::rbd_data.152ffc5dba83.0000000000000010:head by client.5459.0:88 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'35)", 2024-09-17T23:05:39.945 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.934875+0000", 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9827730389999996, 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.003498059, 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934875+0000", 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934875+0000", 2024-09-17T23:05:39.946 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934876+0000", 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.2399999999999997e-07 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934885+0000", 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7239999999999998e-06 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934905+0000", 2024-09-17T23:05:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.0557999999999999e-05 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934920+0000", 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4538e-05 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.934998+0000", 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.8197999999999999e-05 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.948 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.938373+0000", 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0033753170000000001 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 103 entries 103'41 (0'0) error 2:10b4ad11:::rbd_data.152ffc5dba83.0000000000000026:head by client.5459.0:110 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'38)", 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.940388+0000", 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9772602580000003, 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.003339514, 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.949 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940388+0000", 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940388+0000", 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.950 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940389+0000", 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4000000000000002e-07 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940394+0000", 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7169999999999996e-06 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940409+0000", 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4592e-05 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.951 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940424+0000", 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5630000000000001e-05 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940484+0000", 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.9793000000000002e-05 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943727+0000", 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0032432419999999999 2024-09-17T23:05:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 104 entries 103'42 (0'0) error 2:066f7604:::rbd_data.152ffc5dba83.0000000000000027:head by client.5459.0:111 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'38)", 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.940658+0000", 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9769900390000004, 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.003098899, 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.953 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940658+0000", 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940658+0000", 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940659+0000", 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.2899999999999999e-07 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.954 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940664+0000", 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.9509999999999997e-06 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940673+0000", 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.7089999999999997e-06 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940681+0000", 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.3819999999999998e-06 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.955 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.940728+0000", 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7834000000000003e-05 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943757+0000", 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0030285939999999999 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 105 entries 103'43 (0'0) error 2:07e0d52b:::rbd_data.152ffc5dba83.0000000000000028:head by client.5459.0:112 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'38)", 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.941028+0000", 2024-09-17T23:05:39.956 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9766205660000002, 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0053744049999999996, 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941028+0000", 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941028+0000", 2024-09-17T23:05:39.957 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941028+0000", 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.7899999999999999e-07 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941036+0000", 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7230000000000004e-06 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941051+0000", 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5586e-05 2024-09-17T23:05:39.958 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941064+0000", 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2252000000000001e-05 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941143+0000", 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.9320999999999995e-05 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946402+0000", 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.005259044 2024-09-17T23:05:39.959 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 106 entries 103'44 (0'0) error 2:1f546182:::rbd_data.152ffc5dba83.000000000000002a:head by client.5459.0:114 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'39)", 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.941553+0000", 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9760949520000004, 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0048636249999999999, 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.960 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941553+0000", 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941553+0000", 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.961 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941554+0000", 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.1600000000000001e-07 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941561+0000", 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.4080000000000001e-06 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941575+0000", 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4117999999999999e-05 2024-09-17T23:05:39.962 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941584+0000", 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2830000000000001e-06 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.941640+0000", 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6598000000000003e-05 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.963 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946417+0000", 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0047767019999999999 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 108 entries 103'45 (0'0) error 2:15e34b47:::rbd_data.152ffc5dba83.000000000000002d:head by client.5459.0:117 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'39)", 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.943099+0000", 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9745488709999997, 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.003333543, 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.964 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943099+0000", 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943099+0000", 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.965 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943100+0000", 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.0699999999999996e-07 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943112+0000", 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.1746000000000001e-05 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943137+0000", 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 2.5406e-05 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.966 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943156+0000", 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8657000000000001e-05 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.943278+0000", 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.000121729 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.946433+0000", 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0031550979999999998 2024-09-17T23:05:39.967 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 110 entries 103'46 (0'0) error 2:050a4296:::rbd_data.152ffc5dba83.0000000000000031:head by client.5459.0:121 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'41)", 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.944677+0000", 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9729715389999996, 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043145839999999998, 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.968 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944677+0000", 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944677+0000", 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944677+0000", 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0900000000000001e-07 2024-09-17T23:05:39.969 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944686+0000", 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.3180000000000007e-06 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944705+0000", 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.9672000000000001e-05 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.970 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944719+0000", 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4161e-05 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.944777+0000", 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7210999999999998e-05 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.948991+0000", 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0042146129999999999 2024-09-17T23:05:39.971 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 113 entries 103'47 (0'0) error 2:17fc906b:::rbd_data.152ffc5dba83.0000000000000038:head by client.5459.0:128 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'44)", 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.947429+0000", 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9702189810000004, 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0043263529999999998, 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.972 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947429+0000", 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947429+0000", 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947430+0000", 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.1099999999999995e-07 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.973 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947436+0000", 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2280000000000003e-06 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947452+0000", 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5603999999999998e-05 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947460+0000", 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.7469999999999994e-06 2024-09-17T23:05:39.974 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.947518+0000", 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.7621000000000003e-05 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.951756+0000", 2024-09-17T23:05:39.975 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0042375420000000004 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 103/100 rep_tid 121 entries 103'48 (0'0) error 2:06fd94c2:::journal_data.2.152ffc5dba83.1:head by client.5459.0:150 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 103'46)", 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:34.962676+0000", 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 4.9549726510000003, 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001726092, 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.976 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962676+0000", 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962676+0000", 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.977 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962676+0000", 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.13e-07 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962684+0000", 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7249999999999997e-06 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962702+0000", 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.8490000000000001e-05 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.978 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962716+0000", 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.3621000000000001e-05 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.962773+0000", 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.6663000000000003e-05 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:34.964402+0000", 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0016289799999999999 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.979 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 105/100 rep_tid 320 entries 105'99 (0'0) error 2:0bc34117:::rbd_data.181b6e819781.0000000000000001:head by client.6219.0:72 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'97)", 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.948483+0000", 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.969165077, 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0029362149999999998, 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.980 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948483+0000", 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948483+0000", 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948484+0000", 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.6599999999999995e-07 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.981 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948493+0000", 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.3729999999999999e-06 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948511+0000", 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.7895000000000001e-05 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948521+0000", 2024-09-17T23:05:39.982 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.4259999999999992e-06 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948603+0000", 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.2206999999999994e-05 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951419+0000", 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0028165479999999999 2024-09-17T23:05:39.983 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 105/100 rep_tid 323 entries 105'100 (0'0) error 2:02a91cb6:::rbd_data.181b6e819781.0000000000000009:head by client.6219.0:80 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'97)", 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.948857+0000", 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.9687907629999999, 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.002843262, 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.984 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948857+0000", 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948857+0000", 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948858+0000", 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.8800000000000002e-07 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.985 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948867+0000", 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.9719999999999998e-06 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948883+0000", 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5707000000000001e-05 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948898+0000", 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5174000000000001e-05 2024-09-17T23:05:39.986 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.948943+0000", 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 4.5089000000000001e-05 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.951701+0000", 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0027576319999999999 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.987 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 105/100 rep_tid 326 entries 105'102 (0'0) error 2:077136be:::rbd_data.181b6e819781.0000000000000012:head by client.6219.0:89 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'99)", 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.953085+0000", 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.9645630590000001, 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0037730289999999998, 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953085+0000", 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.988 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953085+0000", 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953086+0000", 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.4499999999999997e-07 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953091+0000", 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.66e-06 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.989 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953105+0000", 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.4096e-05 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953118+0000", 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2315e-05 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.953189+0000", 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.1029e-05 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.990 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.956858+0000", 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0036693839999999999 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 105/100 rep_tid 329 entries 105'103 (0'0) error 2:1d6d9d2e:::rbd_data.181b6e819781.0000000000000020:head by client.6219.0:103 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'100)", 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.955915+0000", 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.961732831, 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0037014370000000001, 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.991 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.955915+0000", 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.955915+0000", 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.992 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.955916+0000", 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.0999999999999998e-07 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.955922+0000", 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.4690000000000002e-06 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.955938+0000", 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5041e-05 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.993 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.955946+0000", 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 8.5390000000000007e-06 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.955997+0000", 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.0529999999999999e-05 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.994 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.959617+0000", 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.003620248 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 105/100 rep_tid 337 entries 105'104 (0'0) error 2:00f88d16:::rbd_data.181b6e819781.000000000000002e:head by client.6219.0:118 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'102)", 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.960332+0000", 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.9573158309999998, 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001796698, 2024-09-17T23:05:39.995 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.960332+0000", 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.960332+0000", 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.996 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.960333+0000", 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.3099999999999997e-07 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.960341+0000", 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 7.7519999999999996e-06 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.960357+0000", 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5886e-05 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.997 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.960366+0000", 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 9.6420000000000002e-06 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.960433+0000", 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.6520999999999995e-05 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.962129+0000", 2024-09-17T23:05:39.998 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0016962660000000001 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "description": "pg_update_log_missing(2.0 epoch 105/100 rep_tid 342 entries 105'105 (0'0) error 2:091c3a67:::rbd_data.181b6e819781.0000000000000036:head by client.6219.0:126 0.000000 -2 [r=-2+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 105'103)", 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "initiated_at": "2024-09-17T23:05:37.962982+0000", 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "age": 1.954666298, 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.001943476, 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "continuous": false, 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "type_data": { 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "flag_point": "reached pg", 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "events": [ 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "initiated", 2024-09-17T23:05:39.999 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.962982+0000", 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "header_read", 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.962982+0000", 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "throttled", 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.962983+0000", 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 5.8100000000000003e-07 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "all_read", 2024-09-17T23:05:40.000 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.962989+0000", 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.2999999999999998e-06 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "dispatched", 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.963004+0000", 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.5170999999999999e-05 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "queued_for_pg", 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.963017+0000", 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 1.2991e-05 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "reached_pg", 2024-09-17T23:05:40.001 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.963082+0000", 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 6.5487999999999994e-05 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: "event": "done", 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: "time": "2024-09-17T23:05:37.964925+0000", 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: "duration": 0.0018429449999999999 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-09-17T23:05:40.002 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-09-17T23:05:40.779 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-17T23:05:40.971 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-17T23:05:40.971 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-09-17T23:05:40.971 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T23:05:40.971 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T23:05:40.974 INFO:tasks.ceph.osd.2:Started 2024-09-17T23:05:40.974 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:05:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:no valid command found; 10 closest matches: 2024-09-17T23:05:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:0 2024-09-17T23:05:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:1 2024-09-17T23:05:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:2 2024-09-17T23:05:41.076 INFO:teuthology.orchestra.run.smithi005.stderr:abort 2024-09-17T23:05:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:assert 2024-09-17T23:05:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:config diff 2024-09-17T23:05:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:config diff get 2024-09-17T23:05:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:config get 2024-09-17T23:05:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:config help [] 2024-09-17T23:05:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:config set ... 2024-09-17T23:05:41.077 INFO:teuthology.orchestra.run.smithi005.stderr:admin_socket: invalid command 2024-09-17T23:05:41.078 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T23:05:41.079 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-17T23:05:41.776 INFO:teuthology.orchestra.run.smithi005.stderr:noscrub is unset 2024-09-17T23:05:41.791 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-17T23:05:42.153 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:05:42.150+0000 7fb025aeb640 -1 Falling back to public interface 2024-09-17T23:05:42.774 INFO:teuthology.orchestra.run.smithi005.stderr:nodeep-scrub is unset 2024-09-17T23:05:45.907 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:05:45.904+0000 7fb025aeb640 -1 osd.2 49 log_to_monitors true 2024-09-17T23:05:46.079 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:05:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:no valid command found; 10 closest matches: 2024-09-17T23:05:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:0 2024-09-17T23:05:46.195 INFO:teuthology.orchestra.run.smithi005.stderr:1 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:2 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:abort 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:assert 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:bluefs debug_inject_read_zeros 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:bluefs files list 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:bluefs stats 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:bluestore allocator dump block 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:bluestore allocator fragmentation block 2024-09-17T23:05:46.196 INFO:teuthology.orchestra.run.smithi005.stderr:admin_socket: invalid command 2024-09-17T23:05:46.198 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T23:05:46.198 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-09-17T23:05:46.821 INFO:tasks.ceph.osd.2.smithi005.stderr:2024-09-17T23:05:46.819+0000 7fb019889640 -1 osd.2 89 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:05:51.199 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-17T23:05:51.356 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:05:51.356 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:05:51.356 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:05:51.356 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:05:51.365 INFO:tasks.thrashosds.thrasher:reviving osd 2024-09-17T23:05:51.365 INFO:tasks.thrashosds.thrasher:Reviving osd 1 2024-09-17T23:05:51.365 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T23:05:51.365 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T23:05:51.368 INFO:tasks.ceph.osd.1:Started 2024-09-17T23:05:51.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T23:05:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:no valid command found; 10 closest matches: 2024-09-17T23:05:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:0 2024-09-17T23:05:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:1 2024-09-17T23:05:51.470 INFO:teuthology.orchestra.run.smithi005.stderr:2 2024-09-17T23:05:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:abort 2024-09-17T23:05:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:assert 2024-09-17T23:05:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:config diff 2024-09-17T23:05:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:config diff get 2024-09-17T23:05:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:config get 2024-09-17T23:05:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:config help [] 2024-09-17T23:05:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:config set ... 2024-09-17T23:05:51.471 INFO:teuthology.orchestra.run.smithi005.stderr:admin_socket: invalid command 2024-09-17T23:05:51.473 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T23:05:51.473 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-17T23:05:52.780 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-17T23:05:52.778+0000 7f6c5460d640 -1 Falling back to public interface 2024-09-17T23:05:56.474 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T23:05:56.547 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-17T23:05:56.544+0000 7f6c5460d640 -1 osd.1 21 log_to_monitors true 2024-09-17T23:05:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:no valid command found; 10 closest matches: 2024-09-17T23:05:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:0 2024-09-17T23:05:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:1 2024-09-17T23:05:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:2 2024-09-17T23:05:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:abort 2024-09-17T23:05:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:assert 2024-09-17T23:05:56.593 INFO:teuthology.orchestra.run.smithi005.stderr:bluefs debug_inject_read_zeros 2024-09-17T23:05:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:bluefs files list 2024-09-17T23:05:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:bluefs stats 2024-09-17T23:05:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:bluestore allocator dump block 2024-09-17T23:05:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:bluestore allocator fragmentation block 2024-09-17T23:05:56.594 INFO:teuthology.orchestra.run.smithi005.stderr:admin_socket: invalid command 2024-09-17T23:05:56.595 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T23:05:56.596 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-1, ['dump_ops_in_flight'] 2024-09-17T23:05:57.292 INFO:tasks.ceph.osd.1.smithi005.stderr:2024-09-17T23:05:57.290+0000 7f6c47d2d640 -1 osd.1 115 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T23:06:01.597 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-17T23:06:01.718 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:01.718 INFO:teuthology.orchestra.run.smithi005.stdout: "ops": [], 2024-09-17T23:06:01.718 INFO:teuthology.orchestra.run.smithi005.stdout: "num_ops": 0 2024-09-17T23:06:01.718 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:01.727 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-17T23:06:01.727 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-09-17T23:06:01.728 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-09-17T23:06:02.025 INFO:tasks.ceph.mon.a.smithi005.stderr:2024-09-17T23:06:02.022+0000 7fcae0ef7640 -1 mon.a@0(leader).osd e119 definitely_dead 0 2024-09-17T23:06:02.274 INFO:teuthology.orchestra.run.smithi005.stderr:marked in osd.7. 2024-09-17T23:06:02.290 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-09-17T23:06:02.290 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-17T23:06:02.406 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a: {} 2024-09-17T23:06:02.406 INFO:teuthology.orchestra.run.smithi005.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T23:06:02.417 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b: {} 2024-09-17T23:06:02.417 INFO:teuthology.orchestra.run.smithi005.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T23:06:02.426 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c: {} 2024-09-17T23:06:02.426 INFO:teuthology.orchestra.run.smithi005.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-17T23:06:02.436 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-17T23:06:03.279 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.0 to 1 (10000) 2024-09-17T23:06:03.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-17T23:06:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-17T23:06:04.302 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-17T23:06:05.232 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.3 to 1 (10000) 2024-09-17T23:06:05.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-17T23:06:06.233 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-17T23:06:06.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-17T23:06:07.291 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.4 to 1 (10000) 2024-09-17T23:06:07.308 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-17T23:06:08.294 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-17T23:06:08.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-17T23:06:09.303 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.5 to 1 (10000) 2024-09-17T23:06:09.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-17T23:06:10.305 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-17T23:06:10.324 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-17T23:06:11.311 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.6 to 1 (10000) 2024-09-17T23:06:11.329 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-17T23:06:12.320 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-17T23:06:12.338 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-17T23:06:13.323 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.7 to 1 (10000) 2024-09-17T23:06:13.341 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-17T23:06:14.329 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-17T23:06:14.347 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-17T23:06:15.234 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.2 to 1 (10000) 2024-09-17T23:06:15.251 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-17T23:06:16.338 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-17T23:06:16.355 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-17T23:06:17.340 INFO:teuthology.orchestra.run.smithi005.stderr:reweighted osd.1 to 1 (10000) 2024-09-17T23:06:17.359 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-17T23:06:18.349 INFO:teuthology.orchestra.run.smithi005.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-17T23:06:18.367 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-17T23:06:18.367 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-17T23:06:18.367 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-17T23:06:18.368 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-17T23:06:18.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T23:06:18.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T23:06:18.663 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:18.663 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":136,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:06:18.343675+0000","last_up_change":"2024-09-17T23:05:58.247348+0000","last_in_change":"2024-09-17T23:06:02.266442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T23:02:19.615759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T23:02:24.412869+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":0.75,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6801","nonce":3261733059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6803","nonce":3261733059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6807","nonce":3261733059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6805","nonce":3261733059}]},"public_addr":"172.21.15.5:6801/3261733059","cluster_addr":"172.21.15.5:6803/3261733059","heartbeat_back_addr":"172.21.15.5:6807/3261733059","heartbeat_front_addr":"172.21.15.5:6805/3261733059","state":["exists","up"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":21,"up_from":116,"up_thru":18,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6825","nonce":2381246826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6827","nonce":2381246826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6831","nonce":2381246826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6829","nonce":2381246826}]},"public_addr":"172.21.15.5:6825/2381246826","cluster_addr":"172.21.15.5:6827/2381246826","heartbeat_back_addr":"172.21.15.5:6831/2381246826","heartbeat_front_addr":"172.21.15.5:6829/2381246826","state":["exists","up"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":110,"up_thru":123,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6817","nonce":4293095448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6819","nonce":4293095448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6823","nonce":4293095448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6821","nonce":4293095448}]},"public_addr":"172.21.15.5:6817/4293095448","cluster_addr":"172.21.15.5:6819/4293095448","heartbeat_back_addr":"172.21.15.5:6823/4293095448","heartbeat_front_addr":"172.21.15.5:6821/4293095448","state":["exists","up"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6809","nonce":1475101831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6811","nonce":1475101831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6815","nonce":1475101831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6813","nonce":1475101831}]},"public_addr":"172.21.15.5:6809/1475101831","cluster_addr":"172.21.15.5:6811/1475101831","heartbeat_back_addr":"172.21.15.5:6815/1475101831","heartbeat_front_addr":"172.21.15.5:6813/1475101831","state":["exists","up"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6811","nonce":1406375140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6813","nonce":1406375140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6817","nonce":1406375140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6815","nonce":1406375140}]},"public_addr":"172.21.15.152:6811/1406375140","cluster_addr":"172.21.15.152:6813/1406375140","heartbeat_back_addr":"172.21.15.152:6817/1406375140","heartbeat_front_addr":"172.21.15.152:6815/1406375140","state":["exists","up"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6819","nonce":2095030613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6821","nonce":2095030613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6825","nonce":2095030613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6823","nonce":2095030613}]},"public_addr":"172.21.15.152:6819/2095030613","cluster_addr":"172.21.15.152:6821/2095030613","heartbeat_back_addr":"172.21.15.152:6825/2095030613","heartbeat_front_addr":"172.21.15.152:6823/2095030613","state":["exists","up"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6803","nonce":3030792595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6805","nonce":3030792595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6809","nonce":3030792595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6807","nonce":3030792595}]},"public_addr":"172.21.15.152:6803/3030792595","cluster_addr":"172.21.15.152:6805/3030792595","heartbeat_back_addr":"172.21.15.152:6809/3030792595","heartbeat_front_addr":"172.21.15.152:6807/3030792595","state":["exists","up"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":38,"up_from":99,"up_thru":123,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6827","nonce":1117798824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6829","nonce":1117798824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6833","nonce":1117798824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6831","nonce":1117798824}]},"public_addr":"172.21.15.152:6827/1117798824","cluster_addr":"172.21.15.152:6829/1117798824","heartbeat_back_addr":"172.21.15.152:6833/1117798824","heartbeat_front_addr":"172.21.15.152:6831/1117798824","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.899917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.157860+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.416164+0000","dead_epoch":50},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.907974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.523463+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.326314+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.363775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.492325+0000","dead_epoch":39}],"pg_upmap":[{"pgid":"2.2","osds":[3,7]},{"pgid":"2.3","osds":[2,7]},{"pgid":"2.5","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:06:18.677 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T23:06:18.677 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T23:06:18.965 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:18.965 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":136,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:06:18.343675+0000","last_up_change":"2024-09-17T23:05:58.247348+0000","last_in_change":"2024-09-17T23:06:02.266442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T23:02:19.615759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T23:02:24.412869+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":0.75,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6801","nonce":3261733059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6803","nonce":3261733059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6807","nonce":3261733059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6805","nonce":3261733059}]},"public_addr":"172.21.15.5:6801/3261733059","cluster_addr":"172.21.15.5:6803/3261733059","heartbeat_back_addr":"172.21.15.5:6807/3261733059","heartbeat_front_addr":"172.21.15.5:6805/3261733059","state":["exists","up"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":21,"up_from":116,"up_thru":18,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6825","nonce":2381246826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6827","nonce":2381246826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6831","nonce":2381246826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6829","nonce":2381246826}]},"public_addr":"172.21.15.5:6825/2381246826","cluster_addr":"172.21.15.5:6827/2381246826","heartbeat_back_addr":"172.21.15.5:6831/2381246826","heartbeat_front_addr":"172.21.15.5:6829/2381246826","state":["exists","up"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":110,"up_thru":123,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6817","nonce":4293095448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6819","nonce":4293095448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6823","nonce":4293095448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6821","nonce":4293095448}]},"public_addr":"172.21.15.5:6817/4293095448","cluster_addr":"172.21.15.5:6819/4293095448","heartbeat_back_addr":"172.21.15.5:6823/4293095448","heartbeat_front_addr":"172.21.15.5:6821/4293095448","state":["exists","up"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6809","nonce":1475101831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6811","nonce":1475101831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6815","nonce":1475101831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6813","nonce":1475101831}]},"public_addr":"172.21.15.5:6809/1475101831","cluster_addr":"172.21.15.5:6811/1475101831","heartbeat_back_addr":"172.21.15.5:6815/1475101831","heartbeat_front_addr":"172.21.15.5:6813/1475101831","state":["exists","up"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6811","nonce":1406375140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6813","nonce":1406375140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6817","nonce":1406375140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6815","nonce":1406375140}]},"public_addr":"172.21.15.152:6811/1406375140","cluster_addr":"172.21.15.152:6813/1406375140","heartbeat_back_addr":"172.21.15.152:6817/1406375140","heartbeat_front_addr":"172.21.15.152:6815/1406375140","state":["exists","up"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6819","nonce":2095030613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6821","nonce":2095030613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6825","nonce":2095030613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6823","nonce":2095030613}]},"public_addr":"172.21.15.152:6819/2095030613","cluster_addr":"172.21.15.152:6821/2095030613","heartbeat_back_addr":"172.21.15.152:6825/2095030613","heartbeat_front_addr":"172.21.15.152:6823/2095030613","state":["exists","up"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6803","nonce":3030792595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6805","nonce":3030792595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6809","nonce":3030792595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6807","nonce":3030792595}]},"public_addr":"172.21.15.152:6803/3030792595","cluster_addr":"172.21.15.152:6805/3030792595","heartbeat_back_addr":"172.21.15.152:6809/3030792595","heartbeat_front_addr":"172.21.15.152:6807/3030792595","state":["exists","up"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":38,"up_from":99,"up_thru":123,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6827","nonce":1117798824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6829","nonce":1117798824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6833","nonce":1117798824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6831","nonce":1117798824}]},"public_addr":"172.21.15.152:6827/1117798824","cluster_addr":"172.21.15.152:6829/1117798824","heartbeat_back_addr":"172.21.15.152:6833/1117798824","heartbeat_front_addr":"172.21.15.152:6831/1117798824","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.899917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.157860+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.416164+0000","dead_epoch":50},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.907974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.523463+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.326314+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.363775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.492325+0000","dead_epoch":39}],"pg_upmap":[{"pgid":"2.2","osds":[3,7]},{"pgid":"2.3","osds":[2,7]},{"pgid":"2.5","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:06:18.978 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T23:06:18.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T23:06:18.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T23:06:18.979 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T23:06:18.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T23:06:18.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T23:06:18.980 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T23:06:18.981 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T23:06:19.224 INFO:teuthology.orchestra.run.smithi005.stdout:472446402568 2024-09-17T23:06:19.225 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T23:06:19.234 INFO:teuthology.orchestra.run.smithi005.stdout:55834574901 2024-09-17T23:06:19.234 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T23:06:19.235 INFO:teuthology.orchestra.run.smithi005.stdout:498216206342 2024-09-17T23:06:19.235 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T23:06:19.236 INFO:teuthology.orchestra.run.smithi005.stdout:55834574901 2024-09-17T23:06:19.236 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T23:06:19.237 INFO:teuthology.orchestra.run.smithi005.stdout:425201762316 2024-09-17T23:06:19.237 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T23:06:19.238 INFO:teuthology.orchestra.run.smithi005.stdout:55834574900 2024-09-17T23:06:19.238 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T23:06:19.239 INFO:teuthology.orchestra.run.smithi005.stdout:55834574899 2024-09-17T23:06:19.240 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T23:06:19.241 INFO:teuthology.orchestra.run.smithi005.stdout:55834574901 2024-09-17T23:06:19.241 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T23:06:19.841 INFO:teuthology.orchestra.run.smithi005.stdout:55834574899 2024-09-17T23:06:19.851 INFO:teuthology.orchestra.run.smithi005.stdout:472446402567 2024-09-17T23:06:19.854 INFO:teuthology.orchestra.run.smithi005.stdout:498216206341 2024-09-17T23:06:19.857 INFO:teuthology.orchestra.run.smithi005.stdout:55834574898 2024-09-17T23:06:19.863 INFO:teuthology.orchestra.run.smithi005.stdout:425201762314 2024-09-17T23:06:19.864 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574899 for osd.5 2024-09-17T23:06:19.869 INFO:teuthology.orchestra.run.smithi005.stdout:55834574899 2024-09-17T23:06:19.871 INFO:teuthology.orchestra.run.smithi005.stdout:55834574897 2024-09-17T23:06:19.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 498216206342 got 498216206341 for osd.1 2024-09-17T23:06:19.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 472446402568 got 472446402567 for osd.2 2024-09-17T23:06:19.878 INFO:teuthology.orchestra.run.smithi005.stdout:55834574899 2024-09-17T23:06:19.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574898 for osd.6 2024-09-17T23:06:19.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 425201762316 got 425201762314 for osd.7 2024-09-17T23:06:19.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574899 for osd.0 2024-09-17T23:06:19.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574897 for osd.3 2024-09-17T23:06:19.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574899 for osd.4 2024-09-17T23:06:20.865 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T23:06:20.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T23:06:20.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T23:06:20.882 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T23:06:20.888 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T23:06:20.890 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T23:06:20.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T23:06:20.895 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T23:06:21.298 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:06:21.296+0000 7f7e5bfff640 0 --2- 172.21.15.5:0/4151838835 >> v2:172.21.15.152:3300/0 conn(0x7f7e5c0a9b60 0x7f7e5c0a8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T23:06:21.332 INFO:teuthology.orchestra.run.smithi005.stdout:425201762316 2024-09-17T23:06:21.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 425201762316 got 425201762316 for osd.7 2024-09-17T23:06:21.353 DEBUG:teuthology.parallel:result is None 2024-09-17T23:06:21.449 INFO:teuthology.orchestra.run.smithi005.stdout:55834574901 2024-09-17T23:06:21.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574901 for osd.5 2024-09-17T23:06:21.468 DEBUG:teuthology.parallel:result is None 2024-09-17T23:06:21.483 INFO:teuthology.orchestra.run.smithi005.stdout:55834574899 2024-09-17T23:06:21.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574899 for osd.3 2024-09-17T23:06:21.500 DEBUG:teuthology.parallel:result is None 2024-09-17T23:06:21.525 INFO:teuthology.orchestra.run.smithi005.stdout:472446402568 2024-09-17T23:06:21.525 INFO:teuthology.orchestra.run.smithi005.stdout:498216206342 2024-09-17T23:06:21.525 INFO:teuthology.orchestra.run.smithi005.stdout:55834574901 2024-09-17T23:06:21.532 INFO:teuthology.orchestra.run.smithi005.stdout:55834574901 2024-09-17T23:06:21.535 INFO:teuthology.orchestra.run.smithi005.stdout:55834574900 2024-09-17T23:06:21.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 472446402568 got 472446402568 for osd.2 2024-09-17T23:06:21.543 DEBUG:teuthology.parallel:result is None 2024-09-17T23:06:21.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574901 for osd.0 2024-09-17T23:06:21.545 DEBUG:teuthology.parallel:result is None 2024-09-17T23:06:21.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 498216206342 got 498216206342 for osd.1 2024-09-17T23:06:21.548 DEBUG:teuthology.parallel:result is None 2024-09-17T23:06:21.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574900 for osd.6 2024-09-17T23:06:21.552 DEBUG:teuthology.parallel:result is None 2024-09-17T23:06:21.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574901 got 55834574901 for osd.4 2024-09-17T23:06:21.553 DEBUG:teuthology.parallel:result is None 2024-09-17T23:06:21.553 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-17T23:06:21.553 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:21.879 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:21.879 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:21.891 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-17T23:06:21.616023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1099,"ondisk_log_size":1099,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":249728,"kb_used_data":13844,"kb_used_omap":22,"kb_used_meta":235689,"kb_avail":754724992,"statfs":{"total":773094113280,"available":772838391808,"internally_reserved":0,"allocated":14176256,"data_stored":6881313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":241346502},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.278263"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":614,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:18.351438+0000","last_change":"2024-09-17T23:06:06.244560+0000","last_active":"2024-09-17T23:06:18.351438+0000","last_peered":"2024-09-17T23:06:18.351438+0000","last_clean":"2024-09-17T23:06:18.351438+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:18.351438+0000","last_undegraded":"2024-09-17T23:06:18.351438+0000","last_fullsized":"2024-09-17T23:06:18.351438+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:26.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":415,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-17T23:06:13.514063+0000","last_change":"2024-09-17T23:05:59.272718+0000","last_active":"2024-09-17T23:06:13.514063+0000","last_peered":"2024-09-17T23:06:13.514063+0000","last_clean":"2024-09-17T23:06:13.514063+0000","last_became_active":"2024-09-17T23:05:59.266788+0000","last_became_peered":"2024-09-17T23:05:59.266788+0000","last_unstale":"2024-09-17T23:06:13.514063+0000","last_undegraded":"2024-09-17T23:06:13.514063+0000","last_fullsized":"2024-09-17T23:06:13.514063+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:23:23.161652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064016699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"2"}]},{"pgid":"2.5","version":"105'123","reported_seq":534,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163781+0000","last_change":"2024-09-17T23:05:51.234255+0000","last_active":"2024-09-17T23:06:19.163781+0000","last_peered":"2024-09-17T23:06:19.163781+0000","last_clean":"2024-09-17T23:06:19.163781+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:19.163781+0000","last_undegraded":"2024-09-17T23:06:19.163781+0000","last_fullsized":"2024-09-17T23:06:19.163781+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:31.747097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"105'123","reported_seq":461,"reported_epoch":136,"state":"peering","last_fresh":"2024-09-17T23:06:18.349986+0000","last_change":"2024-09-17T23:06:18.349986+0000","last_active":"2024-09-17T23:05:58.252792+0000","last_peered":"2024-09-17T23:05:57.243651+0000","last_clean":"2024-09-17T23:05:57.243651+0000","last_became_active":"2024-09-17T23:05:49.798985+0000","last_became_peered":"2024-09-17T23:05:49.798985+0000","last_unstale":"2024-09-17T23:06:18.349986+0000","last_undegraded":"2024-09-17T23:06:18.349986+0000","last_fullsized":"2024-09-17T23:06:18.349986+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"105'149","reported_seq":774,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:18.349685+0000","last_change":"2024-09-17T23:06:06.242385+0000","last_active":"2024-09-17T23:06:18.349685+0000","last_peered":"2024-09-17T23:06:18.349685+0000","last_clean":"2024-09-17T23:06:18.349685+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:18.349685+0000","last_undegraded":"2024-09-17T23:06:18.349685+0000","last_fullsized":"2024-09-17T23:06:18.349685+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:16.445209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":398,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163781+0000","last_change":"2024-09-17T23:05:51.237515+0000","last_active":"2024-09-17T23:06:19.163781+0000","last_peered":"2024-09-17T23:06:19.163781+0000","last_clean":"2024-09-17T23:06:19.163781+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:19.163781+0000","last_undegraded":"2024-09-17T23:06:19.163781+0000","last_fullsized":"2024-09-17T23:06:19.163781+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:52:29.163195+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":260,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163194+0000","last_change":"2024-09-17T23:06:03.282054+0000","last_active":"2024-09-17T23:06:19.163194+0000","last_peered":"2024-09-17T23:06:19.163194+0000","last_clean":"2024-09-17T23:06:19.163194+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:19.163194+0000","last_undegraded":"2024-09-17T23:06:19.163194+0000","last_fullsized":"2024-09-17T23:06:19.163194+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:16.002603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"105'159","reported_seq":641,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163792+0000","last_change":"2024-09-17T23:06:06.241426+0000","last_active":"2024-09-17T23:06:19.163792+0000","last_peered":"2024-09-17T23:06:19.163792+0000","last_clean":"2024-09-17T23:06:19.163792+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:19.163792+0000","last_undegraded":"2024-09-17T23:06:19.163792+0000","last_fullsized":"2024-09-17T23:06:19.163792+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:45.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":372,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.162998+0000","last_change":"2024-09-17T23:06:06.238134+0000","last_active":"2024-09-17T23:06:19.162998+0000","last_peered":"2024-09-17T23:06:19.162998+0000","last_clean":"2024-09-17T23:06:19.162998+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:19.162998+0000","last_undegraded":"2024-09-17T23:06:19.162998+0000","last_fullsized":"2024-09-17T23:06:19.162998+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:47:56.986907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762316,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29832,"kb_used_data":2164,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94342008,"statfs":{"total":96636764160,"available":96606216192,"internally_reserved":0,"allocated":2215936,"data_stored":1300878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28612,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343228,"statfs":{"total":96636764160,"available":96607465472,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32768,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28608,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343232,"statfs":{"total":96636764160,"available":96607469568,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1634304,"data_stored":716047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402568,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29504,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342336,"statfs":{"total":96636764160,"available":96606552064,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206342,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30092,"kb_used_data":1592,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341748,"statfs":{"total":96636764160,"available":96605949952,"internally_reserved":0,"allocated":1630208,"data_stored":716028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37524,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334316,"statfs":{"total":96636764160,"available":96598339584,"internally_reserved":0,"allocated":2224128,"data_stored":1306396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:21.892 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:22.179 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:22.191 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-17T23:06:21.616023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1099,"ondisk_log_size":1099,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":249728,"kb_used_data":13844,"kb_used_omap":22,"kb_used_meta":235689,"kb_avail":754724992,"statfs":{"total":773094113280,"available":772838391808,"internally_reserved":0,"allocated":14176256,"data_stored":6881313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":241346502},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.278263"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":614,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:18.351438+0000","last_change":"2024-09-17T23:06:06.244560+0000","last_active":"2024-09-17T23:06:18.351438+0000","last_peered":"2024-09-17T23:06:18.351438+0000","last_clean":"2024-09-17T23:06:18.351438+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:18.351438+0000","last_undegraded":"2024-09-17T23:06:18.351438+0000","last_fullsized":"2024-09-17T23:06:18.351438+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:26.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":415,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-17T23:06:13.514063+0000","last_change":"2024-09-17T23:05:59.272718+0000","last_active":"2024-09-17T23:06:13.514063+0000","last_peered":"2024-09-17T23:06:13.514063+0000","last_clean":"2024-09-17T23:06:13.514063+0000","last_became_active":"2024-09-17T23:05:59.266788+0000","last_became_peered":"2024-09-17T23:05:59.266788+0000","last_unstale":"2024-09-17T23:06:13.514063+0000","last_undegraded":"2024-09-17T23:06:13.514063+0000","last_fullsized":"2024-09-17T23:06:13.514063+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:23:23.161652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064016699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"2"}]},{"pgid":"2.5","version":"105'123","reported_seq":534,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163781+0000","last_change":"2024-09-17T23:05:51.234255+0000","last_active":"2024-09-17T23:06:19.163781+0000","last_peered":"2024-09-17T23:06:19.163781+0000","last_clean":"2024-09-17T23:06:19.163781+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:19.163781+0000","last_undegraded":"2024-09-17T23:06:19.163781+0000","last_fullsized":"2024-09-17T23:06:19.163781+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:31.747097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"105'123","reported_seq":461,"reported_epoch":136,"state":"peering","last_fresh":"2024-09-17T23:06:18.349986+0000","last_change":"2024-09-17T23:06:18.349986+0000","last_active":"2024-09-17T23:05:58.252792+0000","last_peered":"2024-09-17T23:05:57.243651+0000","last_clean":"2024-09-17T23:05:57.243651+0000","last_became_active":"2024-09-17T23:05:49.798985+0000","last_became_peered":"2024-09-17T23:05:49.798985+0000","last_unstale":"2024-09-17T23:06:18.349986+0000","last_undegraded":"2024-09-17T23:06:18.349986+0000","last_fullsized":"2024-09-17T23:06:18.349986+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"105'149","reported_seq":774,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:18.349685+0000","last_change":"2024-09-17T23:06:06.242385+0000","last_active":"2024-09-17T23:06:18.349685+0000","last_peered":"2024-09-17T23:06:18.349685+0000","last_clean":"2024-09-17T23:06:18.349685+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:18.349685+0000","last_undegraded":"2024-09-17T23:06:18.349685+0000","last_fullsized":"2024-09-17T23:06:18.349685+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:16.445209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":398,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163781+0000","last_change":"2024-09-17T23:05:51.237515+0000","last_active":"2024-09-17T23:06:19.163781+0000","last_peered":"2024-09-17T23:06:19.163781+0000","last_clean":"2024-09-17T23:06:19.163781+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:19.163781+0000","last_undegraded":"2024-09-17T23:06:19.163781+0000","last_fullsized":"2024-09-17T23:06:19.163781+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:52:29.163195+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":260,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163194+0000","last_change":"2024-09-17T23:06:03.282054+0000","last_active":"2024-09-17T23:06:19.163194+0000","last_peered":"2024-09-17T23:06:19.163194+0000","last_clean":"2024-09-17T23:06:19.163194+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:19.163194+0000","last_undegraded":"2024-09-17T23:06:19.163194+0000","last_fullsized":"2024-09-17T23:06:19.163194+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:16.002603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"105'159","reported_seq":641,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163792+0000","last_change":"2024-09-17T23:06:06.241426+0000","last_active":"2024-09-17T23:06:19.163792+0000","last_peered":"2024-09-17T23:06:19.163792+0000","last_clean":"2024-09-17T23:06:19.163792+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:19.163792+0000","last_undegraded":"2024-09-17T23:06:19.163792+0000","last_fullsized":"2024-09-17T23:06:19.163792+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:45.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":372,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.162998+0000","last_change":"2024-09-17T23:06:06.238134+0000","last_active":"2024-09-17T23:06:19.162998+0000","last_peered":"2024-09-17T23:06:19.162998+0000","last_clean":"2024-09-17T23:06:19.162998+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:19.162998+0000","last_undegraded":"2024-09-17T23:06:19.162998+0000","last_fullsized":"2024-09-17T23:06:19.162998+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:47:56.986907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762316,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29832,"kb_used_data":2164,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94342008,"statfs":{"total":96636764160,"available":96606216192,"internally_reserved":0,"allocated":2215936,"data_stored":1300878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28612,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343228,"statfs":{"total":96636764160,"available":96607465472,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32768,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28608,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343232,"statfs":{"total":96636764160,"available":96607469568,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1634304,"data_stored":716047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402568,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29504,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342336,"statfs":{"total":96636764160,"available":96606552064,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206342,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30092,"kb_used_data":1592,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341748,"statfs":{"total":96636764160,"available":96605949952,"internally_reserved":0,"allocated":1630208,"data_stored":716028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37524,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334316,"statfs":{"total":96636764160,"available":96598339584,"internally_reserved":0,"allocated":2224128,"data_stored":1306396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:22.192 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T23:06:22.546 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:22.546 INFO:teuthology.orchestra.run.smithi005.stdout:{"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":257,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":137,"num_osds":8,"num_up_osds":8,"osd_up_since":1726614358,"num_in_osds":8,"osd_in_since":1726614362,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":8},{"state_name":"peering","count":1}],"num_pgs":9,"num_pools":2,"num_objects":6,"data_bytes":590387,"bytes_used":255721472,"bytes_avail":772838391808,"bytes_total":773094113280,"inactive_pgs_ratio":0.1111111119389534},"fsmap":{"epoch":1,"btime":"2024-09-17T23:02:05:410405+0000","by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-17T23:03:19.579542+0000","services":{}},"progress_events":{}} 2024-09-17T23:06:22.559 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T23:06:22.559 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:22.863 INFO:teuthology.orchestra.run.smithi005.stderr:2024-09-17T23:06:22.861+0000 7fed0cd62640 0 --2- 172.21.15.5:0/2134337531 >> [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] conn(0x7fecf00039b0 0x7fecf0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-17T23:06:23.047 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:23.048 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:23.060 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-09-17T23:06:21.616023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1099,"ondisk_log_size":1099,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":249728,"kb_used_data":13844,"kb_used_omap":22,"kb_used_meta":235689,"kb_avail":754724992,"statfs":{"total":773094113280,"available":772838391808,"internally_reserved":0,"allocated":14176256,"data_stored":6881313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":241346502},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.278263"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":614,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:18.351438+0000","last_change":"2024-09-17T23:06:06.244560+0000","last_active":"2024-09-17T23:06:18.351438+0000","last_peered":"2024-09-17T23:06:18.351438+0000","last_clean":"2024-09-17T23:06:18.351438+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:18.351438+0000","last_undegraded":"2024-09-17T23:06:18.351438+0000","last_fullsized":"2024-09-17T23:06:18.351438+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:26.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":415,"reported_epoch":131,"state":"active+clean","last_fresh":"2024-09-17T23:06:13.514063+0000","last_change":"2024-09-17T23:05:59.272718+0000","last_active":"2024-09-17T23:06:13.514063+0000","last_peered":"2024-09-17T23:06:13.514063+0000","last_clean":"2024-09-17T23:06:13.514063+0000","last_became_active":"2024-09-17T23:05:59.266788+0000","last_became_peered":"2024-09-17T23:05:59.266788+0000","last_unstale":"2024-09-17T23:06:13.514063+0000","last_undegraded":"2024-09-17T23:06:13.514063+0000","last_fullsized":"2024-09-17T23:06:13.514063+0000","mapping_epoch":116,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T01:23:23.161652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064016699999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3","length":"2"}]},{"pgid":"2.5","version":"105'123","reported_seq":534,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163781+0000","last_change":"2024-09-17T23:05:51.234255+0000","last_active":"2024-09-17T23:06:19.163781+0000","last_peered":"2024-09-17T23:06:19.163781+0000","last_clean":"2024-09-17T23:06:19.163781+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:19.163781+0000","last_undegraded":"2024-09-17T23:06:19.163781+0000","last_fullsized":"2024-09-17T23:06:19.163781+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:31.747097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"105'123","reported_seq":461,"reported_epoch":136,"state":"peering","last_fresh":"2024-09-17T23:06:18.349986+0000","last_change":"2024-09-17T23:06:18.349986+0000","last_active":"2024-09-17T23:05:58.252792+0000","last_peered":"2024-09-17T23:05:57.243651+0000","last_clean":"2024-09-17T23:05:57.243651+0000","last_became_active":"2024-09-17T23:05:49.798985+0000","last_became_peered":"2024-09-17T23:05:49.798985+0000","last_unstale":"2024-09-17T23:06:18.349986+0000","last_undegraded":"2024-09-17T23:06:18.349986+0000","last_fullsized":"2024-09-17T23:06:18.349986+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"105'149","reported_seq":774,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:18.349685+0000","last_change":"2024-09-17T23:06:06.242385+0000","last_active":"2024-09-17T23:06:18.349685+0000","last_peered":"2024-09-17T23:06:18.349685+0000","last_clean":"2024-09-17T23:06:18.349685+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:18.349685+0000","last_undegraded":"2024-09-17T23:06:18.349685+0000","last_fullsized":"2024-09-17T23:06:18.349685+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:16.445209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":398,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163781+0000","last_change":"2024-09-17T23:05:51.237515+0000","last_active":"2024-09-17T23:06:19.163781+0000","last_peered":"2024-09-17T23:06:19.163781+0000","last_clean":"2024-09-17T23:06:19.163781+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:19.163781+0000","last_undegraded":"2024-09-17T23:06:19.163781+0000","last_fullsized":"2024-09-17T23:06:19.163781+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:52:29.163195+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":260,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163194+0000","last_change":"2024-09-17T23:06:03.282054+0000","last_active":"2024-09-17T23:06:19.163194+0000","last_peered":"2024-09-17T23:06:19.163194+0000","last_clean":"2024-09-17T23:06:19.163194+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:19.163194+0000","last_undegraded":"2024-09-17T23:06:19.163194+0000","last_fullsized":"2024-09-17T23:06:19.163194+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:16.002603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"105'159","reported_seq":641,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.163792+0000","last_change":"2024-09-17T23:06:06.241426+0000","last_active":"2024-09-17T23:06:19.163792+0000","last_peered":"2024-09-17T23:06:19.163792+0000","last_clean":"2024-09-17T23:06:19.163792+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:19.163792+0000","last_undegraded":"2024-09-17T23:06:19.163792+0000","last_fullsized":"2024-09-17T23:06:19.163792+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:45.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":372,"reported_epoch":136,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.162998+0000","last_change":"2024-09-17T23:06:06.238134+0000","last_active":"2024-09-17T23:06:19.162998+0000","last_peered":"2024-09-17T23:06:19.162998+0000","last_clean":"2024-09-17T23:06:19.162998+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:19.162998+0000","last_undegraded":"2024-09-17T23:06:19.162998+0000","last_fullsized":"2024-09-17T23:06:19.162998+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:47:56.986907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762316,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29832,"kb_used_data":2164,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94342008,"statfs":{"total":96636764160,"available":96606216192,"internally_reserved":0,"allocated":2215936,"data_stored":1300878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28612,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343228,"statfs":{"total":96636764160,"available":96607465472,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32768,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28608,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343232,"statfs":{"total":96636764160,"available":96607469568,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1634304,"data_stored":716047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402568,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29504,"kb_used_data":1580,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342336,"statfs":{"total":96636764160,"available":96606552064,"internally_reserved":0,"allocated":1617920,"data_stored":710491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206342,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30092,"kb_used_data":1592,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341748,"statfs":{"total":96636764160,"available":96605949952,"internally_reserved":0,"allocated":1630208,"data_stored":716028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37524,"kb_used_data":2172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334316,"statfs":{"total":96636764160,"available":96598339584,"internally_reserved":0,"allocated":2224128,"data_stored":1306396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:26.062 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:26.364 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:26.364 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:26.376 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-17T23:06:25.616940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1099,"ondisk_log_size":1099,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254092,"kb_used_data":14000,"kb_used_omap":22,"kb_used_meta":239849,"kb_avail":754720628,"statfs":{"total":773094113280,"available":772833923072,"internally_reserved":0,"allocated":14336000,"data_stored":6953294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":245606342},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001823"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":616,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.356255+0000","last_change":"2024-09-17T23:06:06.244560+0000","last_active":"2024-09-17T23:06:19.356255+0000","last_peered":"2024-09-17T23:06:19.356255+0000","last_clean":"2024-09-17T23:06:19.356255+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:19.356255+0000","last_undegraded":"2024-09-17T23:06:19.356255+0000","last_fullsized":"2024-09-17T23:06:19.356255+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:26.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":372,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.358298+0000","last_change":"2024-09-17T23:06:19.358298+0000","last_active":"2024-09-17T23:06:19.358298+0000","last_peered":"2024-09-17T23:06:19.358298+0000","last_clean":"2024-09-17T23:06:19.358298+0000","last_became_active":"2024-09-17T23:06:19.357902+0000","last_became_peered":"2024-09-17T23:06:19.357902+0000","last_unstale":"2024-09-17T23:06:19.358298+0000","last_undegraded":"2024-09-17T23:06:19.358298+0000","last_fullsized":"2024-09-17T23:06:19.358298+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:02.264139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"105'123","reported_seq":536,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354593+0000","last_change":"2024-09-17T23:05:51.234255+0000","last_active":"2024-09-17T23:06:19.354593+0000","last_peered":"2024-09-17T23:06:19.354593+0000","last_clean":"2024-09-17T23:06:19.354593+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:19.354593+0000","last_undegraded":"2024-09-17T23:06:19.354593+0000","last_fullsized":"2024-09-17T23:06:19.354593+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:31.747097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"105'123","reported_seq":469,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.357457+0000","last_change":"2024-09-17T23:06:19.357457+0000","last_active":"2024-09-17T23:06:19.357457+0000","last_peered":"2024-09-17T23:06:19.357457+0000","last_clean":"2024-09-17T23:06:19.357457+0000","last_became_active":"2024-09-17T23:06:19.356983+0000","last_became_peered":"2024-09-17T23:06:19.356983+0000","last_unstale":"2024-09-17T23:06:19.357457+0000","last_undegraded":"2024-09-17T23:06:19.357457+0000","last_fullsized":"2024-09-17T23:06:19.357457+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:02.064754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"105'149","reported_seq":776,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.416599+0000","last_change":"2024-09-17T23:06:06.242385+0000","last_active":"2024-09-17T23:06:19.416599+0000","last_peered":"2024-09-17T23:06:19.416599+0000","last_clean":"2024-09-17T23:06:19.416599+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:19.416599+0000","last_undegraded":"2024-09-17T23:06:19.416599+0000","last_fullsized":"2024-09-17T23:06:19.416599+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:16.445209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":400,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354474+0000","last_change":"2024-09-17T23:05:51.237515+0000","last_active":"2024-09-17T23:06:19.354474+0000","last_peered":"2024-09-17T23:06:19.354474+0000","last_clean":"2024-09-17T23:06:19.354474+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:19.354474+0000","last_undegraded":"2024-09-17T23:06:19.354474+0000","last_fullsized":"2024-09-17T23:06:19.354474+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:52:29.163195+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":262,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351513+0000","last_change":"2024-09-17T23:06:03.282054+0000","last_active":"2024-09-17T23:06:19.351513+0000","last_peered":"2024-09-17T23:06:19.351513+0000","last_clean":"2024-09-17T23:06:19.351513+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:19.351513+0000","last_undegraded":"2024-09-17T23:06:19.351513+0000","last_fullsized":"2024-09-17T23:06:19.351513+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:16.002603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"105'159","reported_seq":643,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354702+0000","last_change":"2024-09-17T23:06:06.241426+0000","last_active":"2024-09-17T23:06:19.354702+0000","last_peered":"2024-09-17T23:06:19.354702+0000","last_clean":"2024-09-17T23:06:19.354702+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:19.354702+0000","last_undegraded":"2024-09-17T23:06:19.354702+0000","last_fullsized":"2024-09-17T23:06:19.354702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:45.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":374,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351493+0000","last_change":"2024-09-17T23:06:06.238134+0000","last_active":"2024-09-17T23:06:19.351493+0000","last_peered":"2024-09-17T23:06:19.351493+0000","last_clean":"2024-09-17T23:06:19.351493+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:19.351493+0000","last_undegraded":"2024-09-17T23:06:19.351493+0000","last_fullsized":"2024-09-17T23:06:19.351493+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:47:56.986907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762317,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29864,"kb_used_data":2188,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94341976,"statfs":{"total":96636764160,"available":96606183424,"internally_reserved":0,"allocated":2240512,"data_stored":1311952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32800,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28640,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343200,"statfs":{"total":96636764160,"available":96607436800,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1646592,"data_stored":721584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402569,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29532,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342308,"statfs":{"total":96636764160,"available":96606523392,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206343,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30108,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341732,"statfs":{"total":96636764160,"available":96605933568,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37540,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334300,"statfs":{"total":96636764160,"available":96598323200,"internally_reserved":0,"allocated":2236416,"data_stored":1311933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:26.377 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-17T23:06:26.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-17T23:06:26.688 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T23:06:26.697 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T23:06:26.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:26.986 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:26.986 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:26.998 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-17T23:06:25.616940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1099,"ondisk_log_size":1099,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254092,"kb_used_data":14000,"kb_used_omap":22,"kb_used_meta":239849,"kb_avail":754720628,"statfs":{"total":773094113280,"available":772833923072,"internally_reserved":0,"allocated":14336000,"data_stored":6953294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":245606342},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001823"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":616,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.356255+0000","last_change":"2024-09-17T23:06:06.244560+0000","last_active":"2024-09-17T23:06:19.356255+0000","last_peered":"2024-09-17T23:06:19.356255+0000","last_clean":"2024-09-17T23:06:19.356255+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:19.356255+0000","last_undegraded":"2024-09-17T23:06:19.356255+0000","last_fullsized":"2024-09-17T23:06:19.356255+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:26.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":372,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.358298+0000","last_change":"2024-09-17T23:06:19.358298+0000","last_active":"2024-09-17T23:06:19.358298+0000","last_peered":"2024-09-17T23:06:19.358298+0000","last_clean":"2024-09-17T23:06:19.358298+0000","last_became_active":"2024-09-17T23:06:19.357902+0000","last_became_peered":"2024-09-17T23:06:19.357902+0000","last_unstale":"2024-09-17T23:06:19.358298+0000","last_undegraded":"2024-09-17T23:06:19.358298+0000","last_fullsized":"2024-09-17T23:06:19.358298+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:02.264139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"105'123","reported_seq":536,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354593+0000","last_change":"2024-09-17T23:05:51.234255+0000","last_active":"2024-09-17T23:06:19.354593+0000","last_peered":"2024-09-17T23:06:19.354593+0000","last_clean":"2024-09-17T23:06:19.354593+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:19.354593+0000","last_undegraded":"2024-09-17T23:06:19.354593+0000","last_fullsized":"2024-09-17T23:06:19.354593+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:31.747097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"105'123","reported_seq":469,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.357457+0000","last_change":"2024-09-17T23:06:19.357457+0000","last_active":"2024-09-17T23:06:19.357457+0000","last_peered":"2024-09-17T23:06:19.357457+0000","last_clean":"2024-09-17T23:06:19.357457+0000","last_became_active":"2024-09-17T23:06:19.356983+0000","last_became_peered":"2024-09-17T23:06:19.356983+0000","last_unstale":"2024-09-17T23:06:19.357457+0000","last_undegraded":"2024-09-17T23:06:19.357457+0000","last_fullsized":"2024-09-17T23:06:19.357457+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:02.064754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"105'149","reported_seq":776,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.416599+0000","last_change":"2024-09-17T23:06:06.242385+0000","last_active":"2024-09-17T23:06:19.416599+0000","last_peered":"2024-09-17T23:06:19.416599+0000","last_clean":"2024-09-17T23:06:19.416599+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:19.416599+0000","last_undegraded":"2024-09-17T23:06:19.416599+0000","last_fullsized":"2024-09-17T23:06:19.416599+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:16.445209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":400,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354474+0000","last_change":"2024-09-17T23:05:51.237515+0000","last_active":"2024-09-17T23:06:19.354474+0000","last_peered":"2024-09-17T23:06:19.354474+0000","last_clean":"2024-09-17T23:06:19.354474+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:19.354474+0000","last_undegraded":"2024-09-17T23:06:19.354474+0000","last_fullsized":"2024-09-17T23:06:19.354474+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:52:29.163195+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":262,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351513+0000","last_change":"2024-09-17T23:06:03.282054+0000","last_active":"2024-09-17T23:06:19.351513+0000","last_peered":"2024-09-17T23:06:19.351513+0000","last_clean":"2024-09-17T23:06:19.351513+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:19.351513+0000","last_undegraded":"2024-09-17T23:06:19.351513+0000","last_fullsized":"2024-09-17T23:06:19.351513+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:16.002603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"105'159","reported_seq":643,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354702+0000","last_change":"2024-09-17T23:06:06.241426+0000","last_active":"2024-09-17T23:06:19.354702+0000","last_peered":"2024-09-17T23:06:19.354702+0000","last_clean":"2024-09-17T23:06:19.354702+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:19.354702+0000","last_undegraded":"2024-09-17T23:06:19.354702+0000","last_fullsized":"2024-09-17T23:06:19.354702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:45.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":374,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351493+0000","last_change":"2024-09-17T23:06:06.238134+0000","last_active":"2024-09-17T23:06:19.351493+0000","last_peered":"2024-09-17T23:06:19.351493+0000","last_clean":"2024-09-17T23:06:19.351493+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:19.351493+0000","last_undegraded":"2024-09-17T23:06:19.351493+0000","last_fullsized":"2024-09-17T23:06:19.351493+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:47:56.986907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762317,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29864,"kb_used_data":2188,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94341976,"statfs":{"total":96636764160,"available":96606183424,"internally_reserved":0,"allocated":2240512,"data_stored":1311952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32800,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28640,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343200,"statfs":{"total":96636764160,"available":96607436800,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1646592,"data_stored":721584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402569,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29532,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342308,"statfs":{"total":96636764160,"available":96606523392,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206343,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30108,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341732,"statfs":{"total":96636764160,"available":96605933568,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37540,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334300,"statfs":{"total":96636764160,"available":96598323200,"internally_reserved":0,"allocated":2236416,"data_stored":1311933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:26.999 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:27.286 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:27.286 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:27.298 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-17T23:06:25.616940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1099,"ondisk_log_size":1099,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254092,"kb_used_data":14000,"kb_used_omap":22,"kb_used_meta":239849,"kb_avail":754720628,"statfs":{"total":773094113280,"available":772833923072,"internally_reserved":0,"allocated":14336000,"data_stored":6953294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":245606342},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001823"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":616,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.356255+0000","last_change":"2024-09-17T23:06:06.244560+0000","last_active":"2024-09-17T23:06:19.356255+0000","last_peered":"2024-09-17T23:06:19.356255+0000","last_clean":"2024-09-17T23:06:19.356255+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:19.356255+0000","last_undegraded":"2024-09-17T23:06:19.356255+0000","last_fullsized":"2024-09-17T23:06:19.356255+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:26.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":372,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.358298+0000","last_change":"2024-09-17T23:06:19.358298+0000","last_active":"2024-09-17T23:06:19.358298+0000","last_peered":"2024-09-17T23:06:19.358298+0000","last_clean":"2024-09-17T23:06:19.358298+0000","last_became_active":"2024-09-17T23:06:19.357902+0000","last_became_peered":"2024-09-17T23:06:19.357902+0000","last_unstale":"2024-09-17T23:06:19.358298+0000","last_undegraded":"2024-09-17T23:06:19.358298+0000","last_fullsized":"2024-09-17T23:06:19.358298+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:02.264139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"105'123","reported_seq":536,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354593+0000","last_change":"2024-09-17T23:05:51.234255+0000","last_active":"2024-09-17T23:06:19.354593+0000","last_peered":"2024-09-17T23:06:19.354593+0000","last_clean":"2024-09-17T23:06:19.354593+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:19.354593+0000","last_undegraded":"2024-09-17T23:06:19.354593+0000","last_fullsized":"2024-09-17T23:06:19.354593+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:31.747097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"105'123","reported_seq":469,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.357457+0000","last_change":"2024-09-17T23:06:19.357457+0000","last_active":"2024-09-17T23:06:19.357457+0000","last_peered":"2024-09-17T23:06:19.357457+0000","last_clean":"2024-09-17T23:06:19.357457+0000","last_became_active":"2024-09-17T23:06:19.356983+0000","last_became_peered":"2024-09-17T23:06:19.356983+0000","last_unstale":"2024-09-17T23:06:19.357457+0000","last_undegraded":"2024-09-17T23:06:19.357457+0000","last_fullsized":"2024-09-17T23:06:19.357457+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:02.064754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"105'149","reported_seq":776,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.416599+0000","last_change":"2024-09-17T23:06:06.242385+0000","last_active":"2024-09-17T23:06:19.416599+0000","last_peered":"2024-09-17T23:06:19.416599+0000","last_clean":"2024-09-17T23:06:19.416599+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:19.416599+0000","last_undegraded":"2024-09-17T23:06:19.416599+0000","last_fullsized":"2024-09-17T23:06:19.416599+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:16.445209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":400,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354474+0000","last_change":"2024-09-17T23:05:51.237515+0000","last_active":"2024-09-17T23:06:19.354474+0000","last_peered":"2024-09-17T23:06:19.354474+0000","last_clean":"2024-09-17T23:06:19.354474+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:19.354474+0000","last_undegraded":"2024-09-17T23:06:19.354474+0000","last_fullsized":"2024-09-17T23:06:19.354474+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:52:29.163195+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":262,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351513+0000","last_change":"2024-09-17T23:06:03.282054+0000","last_active":"2024-09-17T23:06:19.351513+0000","last_peered":"2024-09-17T23:06:19.351513+0000","last_clean":"2024-09-17T23:06:19.351513+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:19.351513+0000","last_undegraded":"2024-09-17T23:06:19.351513+0000","last_fullsized":"2024-09-17T23:06:19.351513+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:16.002603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"105'159","reported_seq":643,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354702+0000","last_change":"2024-09-17T23:06:06.241426+0000","last_active":"2024-09-17T23:06:19.354702+0000","last_peered":"2024-09-17T23:06:19.354702+0000","last_clean":"2024-09-17T23:06:19.354702+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:19.354702+0000","last_undegraded":"2024-09-17T23:06:19.354702+0000","last_fullsized":"2024-09-17T23:06:19.354702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:45.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":374,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351493+0000","last_change":"2024-09-17T23:06:06.238134+0000","last_active":"2024-09-17T23:06:19.351493+0000","last_peered":"2024-09-17T23:06:19.351493+0000","last_clean":"2024-09-17T23:06:19.351493+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:19.351493+0000","last_undegraded":"2024-09-17T23:06:19.351493+0000","last_fullsized":"2024-09-17T23:06:19.351493+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:47:56.986907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762317,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29864,"kb_used_data":2188,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94341976,"statfs":{"total":96636764160,"available":96606183424,"internally_reserved":0,"allocated":2240512,"data_stored":1311952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32800,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28640,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343200,"statfs":{"total":96636764160,"available":96607436800,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1646592,"data_stored":721584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402569,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29532,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342308,"statfs":{"total":96636764160,"available":96606523392,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206343,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30108,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341732,"statfs":{"total":96636764160,"available":96605933568,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37540,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334300,"statfs":{"total":96636764160,"available":96598323200,"internally_reserved":0,"allocated":2236416,"data_stored":1311933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:27.298 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T23:06:27.299 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:27.587 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:27.587 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:27.599 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":254,"stamp":"2024-09-17T23:06:25.616940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1099,"ondisk_log_size":1099,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254092,"kb_used_data":14000,"kb_used_omap":22,"kb_used_meta":239849,"kb_avail":754720628,"statfs":{"total":773094113280,"available":772833923072,"internally_reserved":0,"allocated":14336000,"data_stored":6953294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":245606342},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-9,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001823"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":616,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.356255+0000","last_change":"2024-09-17T23:06:06.244560+0000","last_active":"2024-09-17T23:06:19.356255+0000","last_peered":"2024-09-17T23:06:19.356255+0000","last_clean":"2024-09-17T23:06:19.356255+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:19.356255+0000","last_undegraded":"2024-09-17T23:06:19.356255+0000","last_fullsized":"2024-09-17T23:06:19.356255+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:26.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":372,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.358298+0000","last_change":"2024-09-17T23:06:19.358298+0000","last_active":"2024-09-17T23:06:19.358298+0000","last_peered":"2024-09-17T23:06:19.358298+0000","last_clean":"2024-09-17T23:06:19.358298+0000","last_became_active":"2024-09-17T23:06:19.357902+0000","last_became_peered":"2024-09-17T23:06:19.357902+0000","last_unstale":"2024-09-17T23:06:19.358298+0000","last_undegraded":"2024-09-17T23:06:19.358298+0000","last_fullsized":"2024-09-17T23:06:19.358298+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:02.264139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"105'123","reported_seq":536,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354593+0000","last_change":"2024-09-17T23:05:51.234255+0000","last_active":"2024-09-17T23:06:19.354593+0000","last_peered":"2024-09-17T23:06:19.354593+0000","last_clean":"2024-09-17T23:06:19.354593+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:19.354593+0000","last_undegraded":"2024-09-17T23:06:19.354593+0000","last_fullsized":"2024-09-17T23:06:19.354593+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:31.747097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"105'123","reported_seq":469,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.357457+0000","last_change":"2024-09-17T23:06:19.357457+0000","last_active":"2024-09-17T23:06:19.357457+0000","last_peered":"2024-09-17T23:06:19.357457+0000","last_clean":"2024-09-17T23:06:19.357457+0000","last_became_active":"2024-09-17T23:06:19.356983+0000","last_became_peered":"2024-09-17T23:06:19.356983+0000","last_unstale":"2024-09-17T23:06:19.357457+0000","last_undegraded":"2024-09-17T23:06:19.357457+0000","last_fullsized":"2024-09-17T23:06:19.357457+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:02.064754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"105'149","reported_seq":776,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.416599+0000","last_change":"2024-09-17T23:06:06.242385+0000","last_active":"2024-09-17T23:06:19.416599+0000","last_peered":"2024-09-17T23:06:19.416599+0000","last_clean":"2024-09-17T23:06:19.416599+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:19.416599+0000","last_undegraded":"2024-09-17T23:06:19.416599+0000","last_fullsized":"2024-09-17T23:06:19.416599+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:16.445209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":400,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354474+0000","last_change":"2024-09-17T23:05:51.237515+0000","last_active":"2024-09-17T23:06:19.354474+0000","last_peered":"2024-09-17T23:06:19.354474+0000","last_clean":"2024-09-17T23:06:19.354474+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:19.354474+0000","last_undegraded":"2024-09-17T23:06:19.354474+0000","last_fullsized":"2024-09-17T23:06:19.354474+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:52:29.163195+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":262,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351513+0000","last_change":"2024-09-17T23:06:03.282054+0000","last_active":"2024-09-17T23:06:19.351513+0000","last_peered":"2024-09-17T23:06:19.351513+0000","last_clean":"2024-09-17T23:06:19.351513+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:19.351513+0000","last_undegraded":"2024-09-17T23:06:19.351513+0000","last_fullsized":"2024-09-17T23:06:19.351513+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:16.002603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"105'159","reported_seq":643,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354702+0000","last_change":"2024-09-17T23:06:06.241426+0000","last_active":"2024-09-17T23:06:19.354702+0000","last_peered":"2024-09-17T23:06:19.354702+0000","last_clean":"2024-09-17T23:06:19.354702+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:19.354702+0000","last_undegraded":"2024-09-17T23:06:19.354702+0000","last_fullsized":"2024-09-17T23:06:19.354702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:45.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":374,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351493+0000","last_change":"2024-09-17T23:06:06.238134+0000","last_active":"2024-09-17T23:06:19.351493+0000","last_peered":"2024-09-17T23:06:19.351493+0000","last_clean":"2024-09-17T23:06:19.351493+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:19.351493+0000","last_undegraded":"2024-09-17T23:06:19.351493+0000","last_fullsized":"2024-09-17T23:06:19.351493+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:47:56.986907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762317,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29864,"kb_used_data":2188,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94341976,"statfs":{"total":96636764160,"available":96606183424,"internally_reserved":0,"allocated":2240512,"data_stored":1311952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32800,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28640,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343200,"statfs":{"total":96636764160,"available":96607436800,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1646592,"data_stored":721584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402569,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29532,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342308,"statfs":{"total":96636764160,"available":96606523392,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206343,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30108,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341732,"statfs":{"total":96636764160,"available":96605933568,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37540,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334300,"statfs":{"total":96636764160,"available":96598323200,"internally_reserved":0,"allocated":2236416,"data_stored":1311933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:27.600 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T23:06:27.893 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:27.893 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":137,"fsid":"4cb0491c-5273-43ce-9711-0f68bec58f2e","created":"2024-09-17T23:02:05.418126+0000","modified":"2024-09-17T23:06:19.347555+0000","last_up_change":"2024-09-17T23:05:58.247348+0000","last_in_change":"2024-09-17T23:06:02.266442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T23:02:19.615759+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-17T23:02:24.412869+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":4,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":3,"score_stable":3,"optimal_score":0.75,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"69fa22ee-5c14-4f80-82fe-b22939183e4a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6801","nonce":3261733059}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6803","nonce":3261733059}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6807","nonce":3261733059}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":3261733059},{"type":"v1","addr":"172.21.15.5:6805","nonce":3261733059}]},"public_addr":"172.21.15.5:6801/3261733059","cluster_addr":"172.21.15.5:6803/3261733059","heartbeat_back_addr":"172.21.15.5:6807/3261733059","heartbeat_front_addr":"172.21.15.5:6805/3261733059","state":["exists","up"]},{"osd":1,"uuid":"a50256db-895f-4a6b-b83e-e251a3b53e10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":21,"up_from":116,"up_thru":136,"down_at":22,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6825","nonce":2381246826}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6827","nonce":2381246826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6831","nonce":2381246826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":2381246826},{"type":"v1","addr":"172.21.15.5:6829","nonce":2381246826}]},"public_addr":"172.21.15.5:6825/2381246826","cluster_addr":"172.21.15.5:6827/2381246826","heartbeat_back_addr":"172.21.15.5:6831/2381246826","heartbeat_front_addr":"172.21.15.5:6829/2381246826","state":["exists","up"]},{"osd":2,"uuid":"c9ccd893-f5cd-4e9e-a126-4b3b2cfa1ce2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":49,"up_from":110,"up_thru":123,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6817","nonce":4293095448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6819","nonce":4293095448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6823","nonce":4293095448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":4293095448},{"type":"v1","addr":"172.21.15.5:6821","nonce":4293095448}]},"public_addr":"172.21.15.5:6817/4293095448","cluster_addr":"172.21.15.5:6819/4293095448","heartbeat_back_addr":"172.21.15.5:6823/4293095448","heartbeat_front_addr":"172.21.15.5:6821/4293095448","state":["exists","up"]},{"osd":3,"uuid":"b9664ac0-db52-42bb-aa10-9ad23cc7021a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6809","nonce":1475101831}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6811","nonce":1475101831}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6815","nonce":1475101831}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":1475101831},{"type":"v1","addr":"172.21.15.5:6813","nonce":1475101831}]},"public_addr":"172.21.15.5:6809/1475101831","cluster_addr":"172.21.15.5:6811/1475101831","heartbeat_back_addr":"172.21.15.5:6815/1475101831","heartbeat_front_addr":"172.21.15.5:6813/1475101831","state":["exists","up"]},{"osd":4,"uuid":"5a11b2ff-7a67-40ed-8076-90ce187a3d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6811","nonce":1406375140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6813","nonce":1406375140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6817","nonce":1406375140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":1406375140},{"type":"v1","addr":"172.21.15.152:6815","nonce":1406375140}]},"public_addr":"172.21.15.152:6811/1406375140","cluster_addr":"172.21.15.152:6813/1406375140","heartbeat_back_addr":"172.21.15.152:6817/1406375140","heartbeat_front_addr":"172.21.15.152:6815/1406375140","state":["exists","up"]},{"osd":5,"uuid":"2361e4e6-f10b-417b-a976-a037ac890e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":122,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6818","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6819","nonce":2095030613}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6821","nonce":2095030613}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6825","nonce":2095030613}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2095030613},{"type":"v1","addr":"172.21.15.152:6823","nonce":2095030613}]},"public_addr":"172.21.15.152:6819/2095030613","cluster_addr":"172.21.15.152:6821/2095030613","heartbeat_back_addr":"172.21.15.152:6825/2095030613","heartbeat_front_addr":"172.21.15.152:6823/2095030613","state":["exists","up"]},{"osd":6,"uuid":"8d3a457f-9981-4307-ac8e-4d45f1600ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6803","nonce":3030792595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6805","nonce":3030792595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6809","nonce":3030792595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":3030792595},{"type":"v1","addr":"172.21.15.152:6807","nonce":3030792595}]},"public_addr":"172.21.15.152:6803/3030792595","cluster_addr":"172.21.15.152:6805/3030792595","heartbeat_back_addr":"172.21.15.152:6809/3030792595","heartbeat_front_addr":"172.21.15.152:6807/3030792595","state":["exists","up"]},{"osd":7,"uuid":"0d7b3c5f-ec11-4d62-a563-d9575c8ae1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":38,"up_from":99,"up_thru":123,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6827","nonce":1117798824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6829","nonce":1117798824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6833","nonce":1117798824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":1117798824},{"type":"v1","addr":"172.21.15.152:6831","nonce":1117798824}]},"public_addr":"172.21.15.152:6827/1117798824","cluster_addr":"172.21.15.152:6829/1117798824","heartbeat_back_addr":"172.21.15.152:6833/1117798824","heartbeat_front_addr":"172.21.15.152:6831/1117798824","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.899917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.157860+0000","dead_epoch":22},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.416164+0000","dead_epoch":50},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:14.907974+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.523463+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.326314+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.363775+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T23:02:15.492325+0000","dead_epoch":39}],"pg_upmap":[{"pgid":"2.2","osds":[3,7]},{"pgid":"2.3","osds":[2,7]},{"pgid":"2.5","osds":[2,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T23:06:28.907 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T23:06:28.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T23:06:29.048 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:29.048 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T23:06:29.048 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:29.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T23:06:29.355 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T23:06:29.368 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T23:06:29.368 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T23:06:29.495 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:29.495 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T23:06:29.495 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:29.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T23:06:29.794 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T23:06:29.808 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T23:06:29.808 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T23:06:29.934 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:29.934 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-17T23:06:29.934 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:29.945 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T23:06:30.235 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T23:06:30.248 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T23:06:30.248 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T23:06:30.376 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:30.376 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T23:06:30.376 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:30.387 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T23:06:30.681 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T23:06:30.694 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T23:06:30.695 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T23:06:30.822 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:30.822 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T23:06:30.822 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:30.833 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T23:06:31.122 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T23:06:31.134 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T23:06:31.134 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T23:06:31.262 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:31.262 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T23:06:31.262 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:31.272 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T23:06:31.562 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T23:06:31.574 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T23:06:31.575 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T23:06:31.704 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:31.704 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T23:06:31.704 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:31.714 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T23:06:32.006 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T23:06:32.019 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T23:06:32.020 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T23:06:32.146 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-09-17T23:06:32.146 INFO:teuthology.orchestra.run.smithi005.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T23:06:32.147 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-09-17T23:06:32.157 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T23:06:32.450 INFO:teuthology.orchestra.run.smithi005.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T23:06:32.463 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:32.755 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:32.756 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:32.764 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":257,"stamp":"2024-09-17T23:06:31.618148+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1099,"ondisk_log_size":1099,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254092,"kb_used_data":14000,"kb_used_omap":22,"kb_used_meta":239849,"kb_avail":754720628,"statfs":{"total":773094113280,"available":772833923072,"internally_reserved":0,"allocated":14336000,"data_stored":6953294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":245606342},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002644"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":616,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.356255+0000","last_change":"2024-09-17T23:06:06.244560+0000","last_active":"2024-09-17T23:06:19.356255+0000","last_peered":"2024-09-17T23:06:19.356255+0000","last_clean":"2024-09-17T23:06:19.356255+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:19.356255+0000","last_undegraded":"2024-09-17T23:06:19.356255+0000","last_fullsized":"2024-09-17T23:06:19.356255+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:50:26.930893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":372,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.358298+0000","last_change":"2024-09-17T23:06:19.358298+0000","last_active":"2024-09-17T23:06:19.358298+0000","last_peered":"2024-09-17T23:06:19.358298+0000","last_clean":"2024-09-17T23:06:19.358298+0000","last_became_active":"2024-09-17T23:06:19.357902+0000","last_became_peered":"2024-09-17T23:06:19.357902+0000","last_unstale":"2024-09-17T23:06:19.358298+0000","last_undegraded":"2024-09-17T23:06:19.358298+0000","last_fullsized":"2024-09-17T23:06:19.358298+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:25:02.264139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"105'123","reported_seq":536,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354593+0000","last_change":"2024-09-17T23:05:51.234255+0000","last_active":"2024-09-17T23:06:19.354593+0000","last_peered":"2024-09-17T23:06:19.354593+0000","last_clean":"2024-09-17T23:06:19.354593+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:19.354593+0000","last_undegraded":"2024-09-17T23:06:19.354593+0000","last_fullsized":"2024-09-17T23:06:19.354593+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:10:31.747097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"105'123","reported_seq":469,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.357457+0000","last_change":"2024-09-17T23:06:19.357457+0000","last_active":"2024-09-17T23:06:19.357457+0000","last_peered":"2024-09-17T23:06:19.357457+0000","last_clean":"2024-09-17T23:06:19.357457+0000","last_became_active":"2024-09-17T23:06:19.356983+0000","last_became_peered":"2024-09-17T23:06:19.356983+0000","last_unstale":"2024-09-17T23:06:19.357457+0000","last_undegraded":"2024-09-17T23:06:19.357457+0000","last_fullsized":"2024-09-17T23:06:19.357457+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:56:02.064754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"105'149","reported_seq":776,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.416599+0000","last_change":"2024-09-17T23:06:06.242385+0000","last_active":"2024-09-17T23:06:19.416599+0000","last_peered":"2024-09-17T23:06:19.416599+0000","last_clean":"2024-09-17T23:06:19.416599+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:19.416599+0000","last_undegraded":"2024-09-17T23:06:19.416599+0000","last_fullsized":"2024-09-17T23:06:19.416599+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:12:16.445209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":400,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354474+0000","last_change":"2024-09-17T23:05:51.237515+0000","last_active":"2024-09-17T23:06:19.354474+0000","last_peered":"2024-09-17T23:06:19.354474+0000","last_clean":"2024-09-17T23:06:19.354474+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:19.354474+0000","last_undegraded":"2024-09-17T23:06:19.354474+0000","last_fullsized":"2024-09-17T23:06:19.354474+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:52:29.163195+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":262,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351513+0000","last_change":"2024-09-17T23:06:03.282054+0000","last_active":"2024-09-17T23:06:19.351513+0000","last_peered":"2024-09-17T23:06:19.351513+0000","last_clean":"2024-09-17T23:06:19.351513+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:19.351513+0000","last_undegraded":"2024-09-17T23:06:19.351513+0000","last_fullsized":"2024-09-17T23:06:19.351513+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:52:16.002603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"105'159","reported_seq":643,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.354702+0000","last_change":"2024-09-17T23:06:06.241426+0000","last_active":"2024-09-17T23:06:19.354702+0000","last_peered":"2024-09-17T23:06:19.354702+0000","last_clean":"2024-09-17T23:06:19.354702+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:19.354702+0000","last_undegraded":"2024-09-17T23:06:19.354702+0000","last_fullsized":"2024-09-17T23:06:19.354702+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:25.219675+0000","last_clean_scrub_stamp":"2024-09-17T23:02:25.219675+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:39:45.752952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":374,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:19.351493+0000","last_change":"2024-09-17T23:06:06.238134+0000","last_active":"2024-09-17T23:06:19.351493+0000","last_peered":"2024-09-17T23:06:19.351493+0000","last_clean":"2024-09-17T23:06:19.351493+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:19.351493+0000","last_undegraded":"2024-09-17T23:06:19.351493+0000","last_fullsized":"2024-09-17T23:06:19.351493+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T23:02:20.198124+0000","last_clean_scrub_stamp":"2024-09-17T23:02:20.198124+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:47:56.986907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762318,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29864,"kb_used_data":2188,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94341976,"statfs":{"total":96636764160,"available":96606183424,"internally_reserved":0,"allocated":2240512,"data_stored":1311952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32800,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28640,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343200,"statfs":{"total":96636764160,"available":96607436800,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1646592,"data_stored":721584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402570,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29532,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342308,"statfs":{"total":96636764160,"available":96606523392,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206344,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30108,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341732,"statfs":{"total":96636764160,"available":96605933568,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574903,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37540,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334300,"statfs":{"total":96636764160,"available":96598323200,"internally_reserved":0,"allocated":2236416,"data_stored":1311933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:32.767 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-17T23:02:25.219675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=25, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.768 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-17T23:02:25.219675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=25, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.768 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-17T23:02:25.219675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=25, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.768 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-17T23:02:25.219675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=25, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.768 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-17T23:02:25.219675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=25, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.768 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-17T23:02:25.219675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=25, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.768 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-17T23:02:25.219675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=25, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.768 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-17T23:02:25.219675+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=25, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.768 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T23:02:20.198124+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=2, tm_sec=20, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=23, tm_min=6, tm_sec=27, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T23:06:32.769 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T23:06:52.769 DEBUG:teuthology.orchestra.run.smithi005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T23:06:53.070 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-09-17T23:06:53.071 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-09-17T23:06:53.083 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":267,"stamp":"2024-09-17T23:06:51.622371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2964,"num_read_kb":2803,"num_write":581,"num_write_kb":2846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":1221715,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1105,"ondisk_log_size":1105,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":254024,"kb_used_data":14000,"kb_used_omap":22,"kb_used_meta":239849,"kb_avail":754720696,"statfs":{"total":773094113280,"available":772833992704,"internally_reserved":0,"allocated":14336000,"data_stored":6953294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22586,"internal_metadata":245606342},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002379"},"pg_stats":[{"pgid":"2.7","version":"105'141","reported_seq":625,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:32.195155+0000","last_change":"2024-09-17T23:06:32.195182+0000","last_active":"2024-09-17T23:06:32.195155+0000","last_peered":"2024-09-17T23:06:32.195155+0000","last_clean":"2024-09-17T23:06:32.195155+0000","last_became_active":"2024-09-17T23:06:06.243965+0000","last_became_peered":"2024-09-17T23:06:06.243965+0000","last_unstale":"2024-09-17T23:06:32.195155+0000","last_undegraded":"2024-09-17T23:06:32.195155+0000","last_fullsized":"2024-09-17T23:06:32.195155+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'141","last_scrub_stamp":"2024-09-17T23:06:32.195066+0000","last_deep_scrub":"105'141","last_deep_scrub_stamp":"2024-09-17T23:06:32.195066+0000","last_clean_scrub_stamp":"2024-09-17T23:06:32.195066+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T07:09:22.329717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377909,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":435,"num_read_kb":370,"num_write":57,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"105'78","reported_seq":381,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:31.608540+0000","last_change":"2024-09-17T23:06:31.608564+0000","last_active":"2024-09-17T23:06:31.608540+0000","last_peered":"2024-09-17T23:06:31.608540+0000","last_clean":"2024-09-17T23:06:31.608540+0000","last_became_active":"2024-09-17T23:06:19.357902+0000","last_became_peered":"2024-09-17T23:06:19.357902+0000","last_unstale":"2024-09-17T23:06:31.608540+0000","last_undegraded":"2024-09-17T23:06:31.608540+0000","last_fullsized":"2024-09-17T23:06:31.608540+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'78","last_scrub_stamp":"2024-09-17T23:06:31.608421+0000","last_deep_scrub":"105'78","last_deep_scrub_stamp":"2024-09-17T23:06:31.608421+0000","last_clean_scrub_stamp":"2024-09-17T23:06:31.608421+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T02:55:35.362346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":151,"num_write":16,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"105'123","reported_seq":545,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:30.930518+0000","last_change":"2024-09-17T23:06:30.930563+0000","last_active":"2024-09-17T23:06:30.930518+0000","last_peered":"2024-09-17T23:06:30.930518+0000","last_clean":"2024-09-17T23:06:30.930518+0000","last_became_active":"2024-09-17T23:05:51.232459+0000","last_became_peered":"2024-09-17T23:05:51.232459+0000","last_unstale":"2024-09-17T23:06:30.930518+0000","last_undegraded":"2024-09-17T23:06:30.930518+0000","last_fullsized":"2024-09-17T23:06:30.930518+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'123","last_scrub_stamp":"2024-09-17T23:06:30.930387+0000","last_deep_scrub":"105'123","last_deep_scrub_stamp":"2024-09-17T23:06:30.930387+0000","last_clean_scrub_stamp":"2024-09-17T23:06:30.930387+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T11:01:37.351371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001147442,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":578,"num_read_kb":503,"num_write":41,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"137'124","reported_seq":479,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:30.577823+0000","last_change":"2024-09-17T23:06:30.577850+0000","last_active":"2024-09-17T23:06:30.577823+0000","last_peered":"2024-09-17T23:06:30.577823+0000","last_clean":"2024-09-17T23:06:30.577823+0000","last_became_active":"2024-09-17T23:06:19.356983+0000","last_became_peered":"2024-09-17T23:06:19.356983+0000","last_unstale":"2024-09-17T23:06:30.577823+0000","last_undegraded":"2024-09-17T23:06:30.577823+0000","last_fullsized":"2024-09-17T23:06:30.577823+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"137'124","last_scrub_stamp":"2024-09-17T23:06:30.577748+0000","last_deep_scrub":"137'124","last_deep_scrub_stamp":"2024-09-17T23:06:30.577748+0000","last_clean_scrub_stamp":"2024-09-17T23:06:30.577748+0000","objects_scrubbed":1,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T09:28:47.191283+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001256493,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":234,"num_read_kb":270,"num_write":60,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"137'151","reported_seq":787,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:31.609028+0000","last_change":"2024-09-17T23:06:31.609052+0000","last_active":"2024-09-17T23:06:31.609028+0000","last_peered":"2024-09-17T23:06:31.609028+0000","last_clean":"2024-09-17T23:06:31.609028+0000","last_became_active":"2024-09-17T23:06:06.240677+0000","last_became_peered":"2024-09-17T23:06:06.240677+0000","last_unstale":"2024-09-17T23:06:31.609028+0000","last_undegraded":"2024-09-17T23:06:31.609028+0000","last_fullsized":"2024-09-17T23:06:31.609028+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"137'151","last_scrub_stamp":"2024-09-17T23:06:31.608953+0000","last_deep_scrub":"137'151","last_deep_scrub_stamp":"2024-09-17T23:06:31.608953+0000","last_clean_scrub_stamp":"2024-09-17T23:06:31.608953+0000","objects_scrubbed":2,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:08:46.893757+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001121073,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":612,"num_read_kb":583,"num_write":75,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"114'104","reported_seq":409,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:31.969157+0000","last_change":"2024-09-17T23:06:31.969180+0000","last_active":"2024-09-17T23:06:31.969157+0000","last_peered":"2024-09-17T23:06:31.969157+0000","last_clean":"2024-09-17T23:06:31.969157+0000","last_became_active":"2024-09-17T23:05:51.234376+0000","last_became_peered":"2024-09-17T23:05:51.234376+0000","last_unstale":"2024-09-17T23:06:31.969157+0000","last_undegraded":"2024-09-17T23:06:31.969157+0000","last_fullsized":"2024-09-17T23:06:31.969157+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'104","last_scrub_stamp":"2024-09-17T23:06:31.969076+0000","last_deep_scrub":"114'104","last_deep_scrub_stamp":"2024-09-17T23:06:31.969076+0000","last_clean_scrub_stamp":"2024-09-17T23:06:31.969076+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:09:31.933674+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0025138130000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":211,"num_read_kb":216,"num_write":48,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":40960,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"105'105","reported_seq":271,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:32.817945+0000","last_change":"2024-09-17T23:06:32.817982+0000","last_active":"2024-09-17T23:06:32.817945+0000","last_peered":"2024-09-17T23:06:32.817945+0000","last_clean":"2024-09-17T23:06:32.817945+0000","last_became_active":"2024-09-17T23:06:03.281603+0000","last_became_peered":"2024-09-17T23:06:03.281603+0000","last_unstale":"2024-09-17T23:06:32.817945+0000","last_undegraded":"2024-09-17T23:06:32.817945+0000","last_fullsized":"2024-09-17T23:06:32.817945+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'105","last_scrub_stamp":"2024-09-17T23:06:32.817827+0000","last_deep_scrub":"105'105","last_deep_scrub_stamp":"2024-09-17T23:06:32.817827+0000","last_clean_scrub_stamp":"2024-09-17T23:06:32.817827+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T03:06:58.734235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063992900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":183,"num_write":55,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"137'160","reported_seq":653,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:32.959326+0000","last_change":"2024-09-17T23:06:32.959376+0000","last_active":"2024-09-17T23:06:32.959326+0000","last_peered":"2024-09-17T23:06:32.959326+0000","last_clean":"2024-09-17T23:06:32.959326+0000","last_became_active":"2024-09-17T23:06:06.240787+0000","last_became_peered":"2024-09-17T23:06:06.240787+0000","last_unstale":"2024-09-17T23:06:32.959326+0000","last_undegraded":"2024-09-17T23:06:32.959326+0000","last_fullsized":"2024-09-17T23:06:32.959326+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"137'160","last_scrub_stamp":"2024-09-17T23:06:32.959211+0000","last_deep_scrub":"137'160","last_deep_scrub_stamp":"2024-09-17T23:06:32.959211+0000","last_clean_scrub_stamp":"2024-09-17T23:06:32.959211+0000","objects_scrubbed":1,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T04:20:29.930031+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00045440500000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":436,"num_read_kb":427,"num_write":70,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"137'119","reported_seq":385,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-17T23:06:33.839970+0000","last_change":"2024-09-17T23:06:33.840004+0000","last_active":"2024-09-17T23:06:33.839970+0000","last_peered":"2024-09-17T23:06:33.839970+0000","last_clean":"2024-09-17T23:06:33.839970+0000","last_became_active":"2024-09-17T23:06:06.237768+0000","last_became_peered":"2024-09-17T23:06:06.237768+0000","last_unstale":"2024-09-17T23:06:33.839970+0000","last_undegraded":"2024-09-17T23:06:33.839970+0000","last_fullsized":"2024-09-17T23:06:33.839970+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"137'119","last_scrub_stamp":"2024-09-17T23:06:33.839838+0000","last_deep_scrub":"137'119","last_deep_scrub_stamp":"2024-09-17T23:06:33.839838+0000","last_clean_scrub_stamp":"2024-09-17T23:06:33.839838+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-19T10:13:39.272425+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2848,"num_read_kb":2703,"num_write":422,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":40979,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},"log_size":986,"ondisk_log_size":986,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":99,"seq":425201762322,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29852,"kb_used_data":2188,"kb_used_omap":4,"kb_used_meta":27643,"kb_avail":94341988,"statfs":{"total":96636764160,"available":96606195712,"internally_reserved":0,"allocated":2240512,"data_stored":1311952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4427,"internal_metadata":28307125},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32800,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339040,"statfs":{"total":96636764160,"available":96603176960,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28640,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343200,"statfs":{"total":96636764160,"available":96607436800,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32792,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339048,"statfs":{"total":96636764160,"available":96603185152,"internally_reserved":0,"allocated":1646592,"data_stored":721584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":110,"seq":472446402574,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29524,"kb_used_data":1604,"kb_used_omap":5,"kb_used_meta":27898,"kb_avail":94342316,"statfs":{"total":96636764160,"available":96606531584,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5788,"internal_metadata":28567908},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":116,"seq":498216206348,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30100,"kb_used_data":1604,"kb_used_omap":4,"kb_used_meta":28475,"kb_avail":94341740,"statfs":{"total":96636764160,"available":96605941760,"internally_reserved":0,"allocated":1642496,"data_stored":721565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4400,"internal_metadata":29159120},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37528,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334312,"statfs":{"total":96636764160,"available":96598335488,"internally_reserved":0,"allocated":2236416,"data_stored":1311933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1356,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T23:06:53.084 DEBUG:teuthology.orchestra.run.smithi005:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T23:06:53.392 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T23:06:53.392 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T23:06:53.392 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T23:06:53.392 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.436 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T23:06:53.436 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T23:06:53.436 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.478 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T23:06:53.479 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T23:06:53.479 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.520 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T23:06:53.521 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T23:06:53.521 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.561 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T23:06:53.561 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T23:06:53.562 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.595 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T23:06:53.595 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T23:06:53.595 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.666 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T23:06:53.666 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T23:06:53.666 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.744 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T23:06:53.744 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T23:06:53.744 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.818 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T23:06:53.818 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T23:06:53.818 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T23:06:53.819 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.844 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T23:06:53.844 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T23:06:53.844 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.888 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T23:06:53.888 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T23:06:53.888 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T23:06:53.888 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.900 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T23:06:53.900 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T23:06:53.900 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.952 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T23:06:53.952 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T23:06:53.952 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T23:06:53.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-17T23:06:53.964 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-17T23:06:53.964 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T23:06:53.965 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T23:06:53.965 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-17T23:06:54.048 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:06:54.049 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T23:06:54.176 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:06:54.176 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T23:06:54.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:06:54.267 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T23:06:54.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:06:54.325 DEBUG:teuthology.orchestra.run.smithi005:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T23:06:54.400 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:06:54.400 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T23:06:54.556 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:06:54.556 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T23:06:54.632 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:06:54.632 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T23:06:54.684 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:06:54.685 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T23:06:54.746 INFO:tasks.ceph:Archiving mon data... 2024-09-17T23:06:54.747 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/data/mon.a.tgz 2024-09-17T23:06:54.748 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-17T23:06:54.764 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.3B2Wj2Rozb 2024-09-17T23:06:54.764 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.3B2Wj2Rozb 2024-09-17T23:06:54.920 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.3B2Wj2Rozb 2024-09-17T23:06:55.004 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.3B2Wj2Rozb is 383KB 2024-09-17T23:06:55.074 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.3B2Wj2Rozb 2024-09-17T23:06:55.089 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/data/mon.c.tgz 2024-09-17T23:06:55.089 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-09-17T23:06:55.144 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.iuAp4X9B1g 2024-09-17T23:06:55.145 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iuAp4X9B1g 2024-09-17T23:06:55.320 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.iuAp4X9B1g 2024-09-17T23:06:55.404 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.iuAp4X9B1g is 555KB 2024-09-17T23:06:55.474 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.iuAp4X9B1g 2024-09-17T23:06:55.490 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/data/mon.b.tgz 2024-09-17T23:06:55.490 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-09-17T23:06:55.509 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.KdbabYSBtC 2024-09-17T23:06:55.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.KdbabYSBtC 2024-09-17T23:06:55.698 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.KdbabYSBtC 2024-09-17T23:06:55.781 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.KdbabYSBtC is 555KB 2024-09-17T23:06:55.851 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.KdbabYSBtC 2024-09-17T23:06:55.866 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T23:06:55.866 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T23:06:55.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T23:06:55.949 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T23:06:55.985 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T23:06:55.985 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T23:06:55.987 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/remote/smithi005/crash 2024-09-17T23:06:55.988 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T23:06:56.016 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/remote/smithi152/crash 2024-09-17T23:06:56.017 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T23:06:56.050 INFO:tasks.ceph:Compressing logs... 2024-09-17T23:06:56.050 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T23:06:56.060 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T23:06:56.083 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T23:06:56.111 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61245.log 2024-09-17T23:06:56.111 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70577.log 2024-09-17T23:06:56.111 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75943.log 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61245.log: 27.8% -- replaced with /var/log/ceph/ceph-client.admin.61245.log.gz 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46660.log 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70577.log.gz 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39196.log 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75943.log.gz 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59729.log 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46660.log.gz 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69482.log 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39196.log.gz 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59729.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.59729.log.gz /var/log/ceph/ceph-client.admin.48998.log 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53810.log 2024-09-17T23:06:56.112 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69482.log.gz 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48998.log.gz 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69967.log 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53810.log.gz 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70395.log 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55289.log 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69967.log.gz 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71043.log 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70395.log.gz 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74053.log 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55289.log.gz 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74861.log 2024-09-17T23:06:56.113 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71043.log.gz 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76363.log 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74053.log.gz 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63663.log 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74861.log.gz 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53209.log 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76363.log.gz 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64319.log 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63663.log.gz 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60755.log 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53209.log.gz 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70980.log 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64319.log.gz 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51137.log 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60755.log.gz 2024-09-17T23:06:56.114 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70980.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.49956.log 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr: 24.9% -- replaced with /var/log/ceph/ceph-client.admin.70980.log.gz 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60877.log 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51137.log.gz 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.49956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62058.log 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60877.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.69364.log -- replaced with /var/log/ceph/ceph-client.admin.60877.log.gz 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54129.log 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62058.log.gz 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69364.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27158.log 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69364.log.gz 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54129.log.gz 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74836.log 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.tmp-client.admin.27158.log: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.27158.log.gz 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59936.log 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39536.log 2024-09-17T23:06:56.115 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74836.log.gz 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70199.log 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59936.log.gz 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39536.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.48911.log 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39536.log.gz 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70882.log 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70199.log.gz 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.48911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60970.log 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70882.log.gz 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73759.log 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60214.log 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60970.log.gz 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62373.log 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73759.log.gz 2024-09-17T23:06:56.116 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60152.log 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60214.log.gz 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74863.log 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62373.log.gz 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73969.log 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60152.log.gz 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74863.log: 94.5% -- replaced with /var/log/ceph/objectstore_tool.49956.log.gz 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38977.log 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74863.log.gz 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53864.log 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73969.log.gz 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38977.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.51276.log 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38977.log.gz 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53864.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53864.log.gz 2024-09-17T23:06:56.117 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.51276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75189.log 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70861.log 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67868.log 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75189.log.gz 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61989.log 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr: 51.6% -- replaced with /var/log/ceph/ceph-client.admin.70861.log.gz 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70703.log 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67868.log.gz 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66883.log 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61989.log.gz 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73544.log 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70703.log.gz 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr: 94.9% -- replaced with /var/log/ceph/objectstore_tool.48911.log.gz 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46185.log 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66883.log.gz 2024-09-17T23:06:56.118 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57786.log 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73544.log.gz 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.58239.log 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46185.log.gz 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69556.log 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57786.log.gz 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74137.log 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.58239.log: /var/log/ceph/ceph-client.admin.69556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70517.log 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69556.log.gz 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39197.log 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74137.log.gz 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38935.log 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70517.log.gz 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68901.log 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39197.log.gz 2024-09-17T23:06:56.119 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65068.log 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38935.log.gz 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.68901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61593.log 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.51276.log.gz 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68901.log.gz 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53590.log 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65068.log.gz 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70117.log 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61593.log.gz 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.53590.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70054.log 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53590.log.gz 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69925.log 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.70117.log.gz 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73633.log 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70054.log.gz 2024-09-17T23:06:56.120 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74347.log 0.0% 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69925.log.gz 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75188.log 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73633.log.gz 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74347.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.74347.log.gz --verbose 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.74517.log 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65151.log 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75188.log.gz 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74263.log 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74517.log.gz 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50485.log 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65151.log.gz 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74263.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.74263.log.gz -- 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.47276.log 2024-09-17T23:06:56.121 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.50485.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.55328.log 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50485.log.gz 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47276.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47276.log.gz -5 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71250.log 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.55328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71706.log 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71250.log: 95.0% -- replaced with /var/log/ceph/objectstore_tool.58239.log.gz 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66023.log 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71250.log.gz 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71706.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.71706.log.gz /var/log/ceph/ceph-client.admin.75201.log 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39534.log 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66023.log.gz 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70665.log 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75201.log.gz 2024-09-17T23:06:56.122 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51003.log 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39534.log.gz 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69628.log 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr: 51.9% -- replaced with /var/log/ceph/ceph-client.admin.70665.log.gz 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62191.log 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51003.log.gz 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62149.log 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69628.log.gz 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66076.log 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62191.log.gz 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76321.log 0.0% 2024-09-17T23:06:56.123 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62149.log.gz 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33625.log 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33625.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33625.log.gz 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33585.log 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33665.log 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33585.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.33585.log.gz --verbose 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr: -- /var/log/ceph/ceph-client.admin.33378.log 2024-09-17T23:06:56.137 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.42662.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33665.log.gz 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33378.log.gz 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/objectstore_tool.42662.log: /var/log/ceph/ceph-osd.6.log: 89.1%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph.audit.log.gz /var/log/ceph/ceph.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33545.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33545.log.gz 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33505.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33425.log 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.33505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33505.log.gz 2024-09-17T23:06:56.138 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33465.log 2024-09-17T23:06:56.139 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33425.log.gz 2024-09-17T23:06:56.139 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.33465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33465.log.gz 2024-09-17T23:06:56.139 INFO:teuthology.orchestra.run.smithi152.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.42662.log.gz 2024-09-17T23:06:56.185 INFO:teuthology.orchestra.run.smithi152.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T23:06:56.192 INFO:teuthology.orchestra.run.smithi152.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T23:06:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63501.log 2024-09-17T23:06:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66076.log.gz 2024-09-17T23:06:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74858.log 2024-09-17T23:06:56.245 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76321.log.gz 2024-09-17T23:06:56.245 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76111.log 2024-09-17T23:06:56.245 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63501.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62568.log 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74858.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76111.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76237.log 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62353.log 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62568.log: 95.1% 0.0% -- replaced with /var/log/ceph/objectstore_tool.55328.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62568.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48997.log 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76237.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.62353.log: /var/log/ceph/ceph-client.admin.53769.log 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62353.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.48997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39866.log 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48997.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53769.log.gz 2024-09-17T23:06:56.246 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71292.log 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53251.log 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39866.log.gz 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71292.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.71292.log.gz 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75985.log 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47575.log 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53251.log.gz 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74529.log 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75985.log.gz 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70766.log 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47575.log.gz 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76571.log 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74529.log.gz 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76489.log 2024-09-17T23:06:56.247 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70766.log.gz 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76571.log.gz 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60387.log 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66936.log 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76489.log.gz 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60387.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.60387.log.gz 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.74860.log 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66936.log.gz 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62107.log 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47885.log 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74860.log.gz 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71324.log 2024-09-17T23:06:56.248 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62107.log.gz 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47885.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.47885.log.gz 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.40500.log 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49983.log 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71324.log.gz 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40500.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.40500.log.gz 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.76027.log 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.49983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38803.log 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49983.log.gz 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76405.log 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76027.log.gz 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74011.log 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38803.log.gz 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76405.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.76405.log.gz --verbose 2024-09-17T23:06:56.249 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.74857.log 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74011.log.gz 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74857.log.gz 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69750.log 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74221.log 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69750.log: gzip -5 --verbose 6.4% -- -- replaced with /var/log/ceph/ceph-client.admin.69750.log.gz /var/log/ceph/ceph-client.admin.65724.log 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40279.log 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74221.log.gz 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65724.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65724.log.gz 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69075.log 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67235.log 2024-09-17T23:06:56.250 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40279.log.gz 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69075.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.69075.log.gz 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75733.log 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70075.log 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67235.log.gz 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75733.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.75733.log.gz --verbose 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.75200.log 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45740.log 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr: 4.5% -- replaced with /var/log/ceph/ceph-client.admin.70075.log.gz 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75200.log.gz 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71427.log 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41782.log 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45740.log.gz 2024-09-17T23:06:56.251 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71427.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr: 50.1% -- replaced with /var/log/ceph/ceph-client.admin.71427.log.gz 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.41782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39871.log 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41782.log.gz 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33467.log 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39871.log.gz 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70614.log 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70744.log 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33467.log.gz 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70614.log.gz 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70902.log 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64605.log 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70744.log.gz 2024-09-17T23:06:56.252 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70902.log.gz 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70304.log 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59269.log 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64605.log.gz 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40321.log 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70304.log.gz 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68687.log 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59269.log.gz 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46462.log 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40321.log.gz 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.68687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70466.log 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68687.log.gz 2024-09-17T23:06:56.253 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40069.log 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46462.log.gz 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61755.log 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.70466.log.gz 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59851.log 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40069.log.gz 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61755.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.61755.log.gz --verbose 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/objectstore_tool.41565.log 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70922.log 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59851.log.gz 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.41565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68860.log 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54055.log 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr: 53.2% -- replaced with /var/log/ceph/ceph-client.admin.70922.log.gz 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.68860.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40111.log 2024-09-17T23:06:56.254 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68860.log.gz 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39201.log 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54055.log.gz 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64104.log 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40111.log.gz 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38859.log 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39201.log.gz 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61303.log 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64104.log.gz 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75649.log 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38859.log.gz 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61303.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.40609.log 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61303.log.gz 2024-09-17T23:06:56.255 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60642.log 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75649.log.gz 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47696.log 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.40609.log: /var/log/ceph/ceph-client.admin.60642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71397.log 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60642.log.gz 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47696.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.57255.log 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47696.log.gz 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59443.log 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71397.log.gz 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.57255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66668.log 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59443.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59443.log.gz 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39528.log 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66668.log.gz 2024-09-17T23:06:56.256 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75691.log 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39528.log.gz 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71392.log 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75691.log.gz 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr: 95.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56296.log 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/objectstore_tool.41565.log.gz 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69962.log 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71392.log.gz 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67138.log 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56296.log.gz 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45480.log 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69962.log: 4.5% -- replaced with /var/log/ceph/ceph-client.admin.69962.log.gz 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67138.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.67138.log.gz -- 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.52309.log 2024-09-17T23:06:56.257 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45480.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45480.log.gz 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.75859.log 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52309.log.gz 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65839.log 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67612.log 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75859.log.gz 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56338.log 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65839.log.gz 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.40609.log.gz 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70830.log 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67612.log.gz 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.56338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74528.log 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56338.log.gz 2024-09-17T23:06:56.258 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39192.log 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70830.log.gz 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74528.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.74528.log.gz -- 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.45782.log 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr: 95.0% -- replaced with /var/log/ceph/objectstore_tool.57255.log.gz 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73801.log 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39192.log.gz 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75523.log 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45782.log.gz 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73801.log.gz 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39200.log 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75523.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr: 27.8% -- replaced with /var/log/ceph/ceph-client.admin.75523.log.gz 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39200.log.gz 2024-09-17T23:06:56.259 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75817.log 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64820.log 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65550.log 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75817.log.gz 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64820.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64820.log.gz -5 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47256.log 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64995.log 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65550.log.gz 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68525.log 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70302.log 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64995.log.gz 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70960.log 2024-09-17T23:06:56.260 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.68525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68525.log.gz 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65468.log 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70302.log.gz 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70960.log.gz 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63284.log 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45616.log 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65468.log.gz 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53894.log 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63284.log.gz 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71143.log 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45616.log.gz 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69726.log 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.53894.log.gz 2024-09-17T23:06:56.261 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39537.log 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71143.log.gz 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39199.log 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69726.log.gz 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39537.log.gz 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75061.log 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67377.log 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39199.log.gz 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75061.log.gz 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67767.log 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75198.log 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67377.log.gz 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39198.log 2024-09-17T23:06:56.262 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67767.log.gz 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67665.log 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75198.log: 25.6% -- replaced with /var/log/ceph/ceph-client.admin.75198.log.gz 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70340.log 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39198.log.gz 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39869.log 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67665.log.gz 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40153.log 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70340.log: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.70340.log.gz 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46840.log 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39869.log.gz 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40153.log.gz 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69673.log 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39522.log 2024-09-17T23:06:56.263 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46840.log.gz 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64266.log 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69673.log.gz 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39522.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.39522.log.gz /var/log/ceph/ceph-client.admin.66506.log 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70943.log 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64266.log.gz 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47179.log 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66506.log.gz 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74526.log 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70943.log.gz 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70473.log 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47179.log.gz 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39019.log 2024-09-17T23:06:56.264 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74526.log.gz 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70473.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70473.log.gz -5 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75397.log 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45081.log 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39019.log.gz 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74305.log 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75397.log.gz 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45081.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45081.log.gz /var/log/ceph/ceph-client.admin.53466.log 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74305.log.gz 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53466.log.gz 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69444.log 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75481.log 2024-09-17T23:06:56.265 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.69444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39195.log 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69444.log.gz 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.75481.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.69608.log 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75481.log.gz 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39195.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39195.log.gz 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65335.log 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69608.log: 5.5% -- replaced with /var/log/ceph/ceph-client.admin.69608.log.gz 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45005.log 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65335.log.gz 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71270.log 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45005.log.gz 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63244.log 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.71270.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74522.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71270.log.gz 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.266 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63244.log.gz 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59503.log 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69504.log 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74522.log.gz 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59503.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59503.log.gz -5 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71600.log 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74516.log 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69504.log.gz 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71600.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71600.log.gz 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51309.log 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74516.log.gz 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74527.log 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.51309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69347.log 2024-09-17T23:06:56.267 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51309.log.gz 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.74527.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61929.log 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74527.log.gz 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61827.log 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69347.log.gz 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69822.log 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61929.log.gz 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61827.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61827.log.gz 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75607.log 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69822.log.gz 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63877.log 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64422.log 2024-09-17T23:06:56.268 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75607.log.gz 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44511.log 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63877.log.gz 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75199.log 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64422.log.gz 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.44511.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39752.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44511.log.gz 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75199.log.gz 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.43398.log 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39752.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39752.log.gz 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45284.log 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.43398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54370.log 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45284.log.gz 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39873.log 2024-09-17T23:06:56.269 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.54370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54370.log.gz 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67961.log 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39873.log.gz 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70096.log 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67961.log.gz 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70179.log 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70096.log.gz 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59190.log 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70179.log.gz 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45824.log 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59190.log.gz 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39870.log 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45824.log.gz 2024-09-17T23:06:56.270 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68083.log 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39870.log.gz 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75775.log 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.68083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68083.log.gz 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55544.log 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75775.log.gz 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64483.log 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.55544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55544.log.gz 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64483.log.gz 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47178.log 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr: 94.9% -- replaced with /var/log/ceph/objectstore_tool.43398.log.gz 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67437.log 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47178.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47178.log.gz 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71178.log 2024-09-17T23:06:56.271 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67437.log.gz 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76447.log 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71178.log: gzip -5 --verbose -- 53.6% -- replaced with /var/log/ceph/ceph-client.admin.71178.log.gz 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.64361.log 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76447.log.gz 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44964.log 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.64361.log: -- /var/log/ceph/ceph-client.admin.65940.log 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64361.log.gz 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44964.log.gz 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69999.log 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65940.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39753.log 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65940.log.gz 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59852.log 2024-09-17T23:06:56.272 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69999.log.gz 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39753.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39753.log.gz 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73927.log 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59852.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66721.log 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59852.log.gz 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73927.log.gz 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62621.log 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz/var/log/ceph/ceph-client.admin.66721.log: 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66721.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53644.log 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63017.log/var/log/ceph/ceph-client.admin.62621.log: 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62621.log.gz 2024-09-17T23:06:56.273 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53644.log.gz 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.40195.log 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63017.log.gz 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45866.log 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63816.log 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40195.log.gz 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71148.log 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45866.log.gz 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33054.log 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63816.log.gz 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70798.log 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71148.log.gz 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74095.log 2024-09-17T23:06:56.274 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33054.log.gz 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62935.log 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70798.log.gz 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74095.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74095.log.gz 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.70724.log 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.62935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62935.log.gz 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73717.log 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75439.log 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70724.log.gz 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73717.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73717.log.gz 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38884.log 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76153.log 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75439.log.gz 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.38884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70412.log 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38884.log.gz 2024-09-17T23:06:56.275 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69325.log 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76153.log.gz 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70412.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.56271.log 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.70412.log.gz 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:gzip/var/log/ceph/ceph-client.admin.69325.log: -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.69325.log.gz /var/log/ceph/ceph-client.admin.74179.log 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.56271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52913.log 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74179.log.gz 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40383.log 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52913.log.gz 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69128.log 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40383.log.gz 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44707.log 2024-09-17T23:06:56.276 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69128.log.gz 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58481.log 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43339.log 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44707.log: /var/log/ceph/ceph-client.admin.58481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44707.log.gz 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58481.log.gz 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69648.log 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43339.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.42554.log 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43339.log.gz 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69648.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.47886.log 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69648.log.gz 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45906.log 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.42554.log: /var/log/ceph/objectstore_tool.47886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63191.log 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45906.log.gz 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76195.log 2024-09-17T23:06:56.277 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63191.log.gz 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 95.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.69461.log 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/objectstore_tool.56271.log.gz 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64780.log 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76195.log.gz 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69461.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46517.log 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.64780.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70686.log 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64780.log.gz 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69290.log 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46517.log.gz 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70686.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75901.log 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70686.log.gz 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52597.log 2024-09-17T23:06:56.278 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69290.log.gz 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75901.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40502.log 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75901.log.gz 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75197.log 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52597.log.gz 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40502.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47520.log 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40502.log.gz 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61091.log 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75197.log.gz 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr: 94.7%/var/log/ceph/ceph-client.admin.47520.log: -- replaced with /var/log/ceph/objectstore_tool.47886.log.gz 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47520.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69384.log 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64051.log 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61091.log.gz 2024-09-17T23:06:56.279 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44687.log 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69384.log: /var/log/ceph/ceph-client.admin.64051.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.54342.log 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69384.log.gz 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64051.log.gz 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.42554.log.gz 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.44687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46860.log 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44687.log.gz 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/objectstore_tool.54342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73675.log 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46860.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46860.log.gz 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.75565.log 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73675.log.gz 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71075.log 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.75565.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75565.log.gz 2024-09-17T23:06:56.280 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45658.log 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71075.log.gz 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73885.log 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45658.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45658.log.gz 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr: --verbose -- /var/log/ceph/ceph-client.admin.57489.log 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73885.log.gz 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76279.log 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.57489.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57489.log.gz 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45928.log 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76279.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68257.log 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.76279.log.gz 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69406.log 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45928.log.gz 2024-09-17T23:06:56.281 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.68257.log: -- /var/log/ceph/ceph-client.admin.33356.log 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68257.log.gz 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69406.log.gz 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46240.log 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39530.log 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.33356.log: /var/log/ceph/ceph-client.admin.46240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70251.log 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46240.log.gz 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33356.log.gz 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39530.log.gz 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76531.log 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70251.log.gz 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39872.log 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr:gzip 95.0% -- replaced with /var/log/ceph/objectstore_tool.54342.log.gz 2024-09-17T23:06:56.282 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.76531.log: -- /var/log/ceph/ceph-client.admin.74865.log 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76531.log.gz 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39872.log.gz 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66238.log 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74865.log.gz 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61520.log 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65048.log 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66238.log.gz 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.61520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65744.log 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61520.log.gz 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65048.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.66391.log 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65048.log.gz 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62803.log 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65744.log.gz 2024-09-17T23:06:56.283 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52229.log 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66391.log.gz 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63448.log/var/log/ceph/ceph-client.admin.62803.log: 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62803.log.gz/var/log/ceph/ceph-client.admin.52229.log: 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52229.log.gz 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39532.log 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40237.log 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.63448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63448.log.gz 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.39532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69588.log 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39532.log.gz 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.40237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68472.log 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40237.log.gz 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67097.log 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr: 5.5% -- replaced with /var/log/ceph/ceph-client.admin.69588.log.gz 2024-09-17T23:06:56.284 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.68472.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.59658.log 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68472.log.gz 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65233.log 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67097.log.gz 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.59658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38714.log 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59658.log.gz 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60467.log 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.65233.log: /var/log/ceph/ceph-client.admin.38714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65233.log.gz 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73843.log 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38714.log.gz 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60467.log.gz 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71001.log 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.73843.log: /var/log/ceph/ceph-client.admin.73586.log 2024-09-17T23:06:56.285 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73843.log.gz 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69427.log 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.71001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71001.log.gz 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.73586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53847.log 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73586.log.gz 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43964.log 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69427.log.gz 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.53847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74521.log 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53847.log.gz 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.43964.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43964.log.gz 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52503.log 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70138.log 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74521.log.gz 2024-09-17T23:06:56.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69535.log 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52503.log.gz 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.70138.log: gzip -5 --verbose -- 60.2% -- replaced with /var/log/ceph/ceph-client.admin.70138.log.gz 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr: /var/log/ceph/ceph-client.admin.67193.log 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69535.log.gz 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52739.log 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.67193.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67193.log.gz 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr: -- /var/log/ceph/ceph-client.admin.47117.log 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52739.log.gz 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47117.log.gz 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52975.log 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60019.log 2024-09-17T23:06:56.287 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.52975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52975.log.gz 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45698.log 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.60019.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60019.log.gz 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46559.log 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.45698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45698.log.gz 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76069.log 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.46559.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46559.log.gz 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39526.log 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.76069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76069.log.gz 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69729.log 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.39526.log: /var/log/ceph/ceph-client.admin.47973.log 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39526.log.gz 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.69729.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53789.log 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69729.log.gz 2024-09-17T23:06:56.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.47973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74853.log 2024-09-17T23:06:56.289 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47973.log.gz 2024-09-17T23:06:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53789.log: -- /var/log/ceph/ceph-client.admin.68277.log 2024-09-17T23:06:56.289 INFO:teuthology.orchestra.run.smithi005.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53789.log.gz 2024-09-17T23:06:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.74853.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66452.log 2024-09-17T23:06:56.289 INFO:teuthology.orchestra.run.smithi005.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74853.log.gz 2024-09-17T23:06:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.68277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68277.log.gz 2024-09-17T23:06:56.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/ceph-client.admin.66452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66452.log.gz 2024-09-17T23:06:56.289 INFO:teuthology.orchestra.run.smithi005.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T23:06:56.290 INFO:teuthology.orchestra.run.smithi152.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T23:06:56.299 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T23:06:56.310 INFO:teuthology.orchestra.run.smithi152.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T23:06:56.329 INFO:teuthology.orchestra.run.smithi005.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T23:06:56.356 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T23:06:56.375 INFO:teuthology.orchestra.run.smithi152.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T23:06:56.377 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-09-17T23:06:56.377 INFO:teuthology.orchestra.run.smithi152.stderr:real 0m0.267s 2024-09-17T23:06:56.378 INFO:teuthology.orchestra.run.smithi152.stderr:user 0m0.937s 2024-09-17T23:06:56.378 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m0.051s 2024-09-17T23:06:56.391 INFO:teuthology.orchestra.run.smithi005.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T23:06:56.444 INFO:teuthology.orchestra.run.smithi005.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T23:06:56.446 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-09-17T23:06:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m0.373s 2024-09-17T23:06:56.446 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m1.238s 2024-09-17T23:06:56.447 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.238s 2024-09-17T23:06:56.447 INFO:tasks.ceph:Archiving logs... 2024-09-17T23:06:56.447 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/remote/smithi005/log 2024-09-17T23:06:56.448 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T23:06:56.942 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/remote/smithi152/log 2024-09-17T23:06:56.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T23:06:57.086 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T23:06:57.113 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T23:06:57.113 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T23:06:57.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T23:06:57.194 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T23:06:57.202 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T23:06:57.203 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T23:06:57.205 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T23:06:57.219 INFO:teuthology.orchestra.run.smithi005.stderr:bash: line 1: ntpq: command not found 2024-09-17T23:06:57.220 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-09-17T23:06:57.224 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T23:06:57.224 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-09-17T23:06:57.224 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 -133us[ -136us] +/- 53ms 2024-09-17T23:06:57.224 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -550us[ -550us] +/- 51ms 2024-09-17T23:06:57.224 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +912us[ +912us] +/- 72ms 2024-09-17T23:06:57.224 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T23:06:57.225 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T23:06:57.225 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-09-17T23:06:57.225 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 -104us[ -94us] +/- 53ms 2024-09-17T23:06:57.225 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -558us[ -549us] +/- 51ms 2024-09-17T23:06:57.225 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +927us[ +937us] +/- 72ms 2024-09-17T23:06:57.225 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T23:06:57.226 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T23:06:57.234 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T23:06:57.234 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T23:06:57.243 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T23:06:57.349 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T23:06:57.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T23:06:57.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T23:06:57.457 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-17T23:06:57.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T23:06:57.486 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T23:06:57.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T23:06:57.503 INFO:teuthology.task.internal:Duration was 701.102208 seconds 2024-09-17T23:06:57.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T23:06:57.512 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T23:06:57.512 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T23:06:57.515 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T23:06:57.552 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T23:06:57.564 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T23:06:57.899 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T23:06:57.899 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-09-17T23:06:57.899 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T23:06:57.961 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-09-17T23:06:57.961 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T23:06:57.985 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T23:06:57.985 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T23:06:58.004 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T23:06:58.052 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T23:06:58.052 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T23:06:58.073 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T23:06:58.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T23:06:58.252 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T23:06:58.252 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T23:06:58.278 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T23:06:58.303 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T23:06:58.313 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T23:06:58.320 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T23:06:58.342 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-09-17T23:06:58.366 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-09-17T23:06:58.405 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T23:06:58.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T23:06:58.420 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T23:06:58.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T23:06:58.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T23:06:58.469 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T23:06:58.470 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/remote/smithi005 2024-09-17T23:06:58.470 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T23:06:58.506 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-17_21:16:02-rbd-squid-distro-default-smithi/7909565/remote/smithi152 2024-09-17T23:06:58.506 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T23:06:58.540 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T23:06:58.540 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T23:06:58.542 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T23:06:58.590 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T23:06:58.601 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T23:06:58.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T23:06:58.640 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T23:06:58.640 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T23:06:58.643 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T23:06:58.656 INFO:teuthology.orchestra.run.smithi005.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 23:06 /home/ubuntu/cephtest 2024-09-17T23:06:58.657 INFO:teuthology.orchestra.run.smithi152.stdout: 265336 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 23:06 /home/ubuntu/cephtest 2024-09-17T23:06:58.659 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T23:06:58.668 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T23:06:58.688 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/journal} duration: 701.1022081375122 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-17T23:06:58.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T23:06:58.785 INFO:teuthology.run:pass